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- USE QF PUPIL-PE RCEIVED NEEDS ASSESSMENT PACKAGE " 

* ' " ' • • • — , I • - . . I ■ I . _ I, 

The Pupil -Perceived "Needs Assessment I^ackage contains an initro- . 
ductory tape cassette, five units, and a Supplemwit on saiipling. . 
The taiie cassette provides a broa^. picture o£ the package J it can also 
be used as an introduction to the package for members of the groxxps 
responsible for specific tasks. It is .strongly reconmended that per- 
sonnel from various levels of. the school system (e.g., Assistant 

^ • ■ . 

Superintendent, Principals^ Curriculun Speciali&ip Teachers, Evaluat^rs, 
Researchers, etc.) participate in this project, i 

^ The unit titles correspond tcj the fiver main tasks involved in this 
method of collecting information from piqii^s: Plaimuig -a^PPNAnRojeci^, 
P^eloping^a.PPNA Indicator, Adndnisterui^ir^ Micator, Process- 
ing PPNA I ndic ator Data, and^^i^lyguig and Re port ing. PPNA Results. The 
Supplement, however^s-to^ be used only when th<* sampling effort is men- 
tioned, j..e^1jrtliis unit when sanple size determined and in Unit 4 . 
when^final sample is selected. 

The different tasks are designed to be performed by people With 
ap^i-opriate knowledge and experience. Since the number.of people in-, 
volved will vaiy from task to task, the liumber of copies needed will vary 
from unit to unit^ For instance, one copy of Unit 1 will be^eeded fo^r 
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the Project Manager,, thw td six copies of Unit 2 for members of the 
developmenA groiq?; 50 copies of llhit 3 .for those administering , the 
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PUPIL>PERCEtVfeD NEEDS ASSESS^ef^ Q^T^ 



R 

"} ■ 

Information collection is almost always the first ^tep io under- 
take in th^ process of planning and ijnproving.sd^iool programs. The. 
• educational pitcess involves different groups of people, e.g.", admin- 
istrators , teachers , pupils , parents , citizens , . State Department of 
Education enployees, etc* Each o£ these groups approaches educatitxnal 
needs from a different, perspective. Unfortunately, current school 
curricula and programs usually reflect only what other people- - 
, administrators , teachers, parents, 'etc; --consider appropriate for 
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indicator (assumirig that 50 classes participate), two to five* copies 

of Unit 4 for the gigjjup who process the data, one to six copies of ' 

Unit 5 „for those involved ji analyz,ing and reporting the r^sul-JiSji ayid 

one or two copies of the Supplement on sampling. ' , 

Colored pages are used in this package so^that the exercises and . \ 
worksheets (green pages) as well as checklists information sheets 
(pink pagfes) stand out from the main text for easy reference at' later 
.stages of the informatiolr-gatlierihg process. 



pupils, while the pupils* own feelings are ^ot taken into account. - 
This approach cripples the attempts of school system personnel to make 
sound decisions related to planning and improvement. 

The purpose of this package is to assist -school, personnel in col- 
lecting information on pup|l attitudes /"reactions, and fe^iSgs tovraird 
existing or new programs „(both curricular and extra-ciirriculdr) or 
toward education in general, and in assessing pupil needs from the • 
pupils ' perspective . Infonnation on piipil -perceived needs , together ^ 

. with other data, will prove useful tb school district personnel in mak> 

. ■ . . . • V • - *' ' — - ^ 

^ng decisions related to planning and iJi?)rovement . Supplementary data 

"^may include informaUon gatl^ered from teacjiers, parents, citizens, 

state policy -makers, 6tc. " In a sound decision-making process, cbnsider- 

n ■■ . , 

ations such as the politics of the situation, the., availability of 
resources, value trade-offs and alternatives,, etc. , should aiso be 
taken into account,, althou^^h these factors are not discussed in this 
package, I .; " , ' 

Refte school district personnel decide to use this package i it. 
is stron^y recommerided that they determine the relative weight the , 
,pupil info^rmation gathered With this package should be given compared 
with other ^ kinds of pupil data (e.g. , pupil academic pe_rformance) and 
data from the other groups mentioned in the foregoing paragraphs • To 

■ ■ ■ ■ ■ 



• ■ • . X • ■ ■ ■ 

maS:e this determination, questions such as those listed below should 

be considered: , . ' j ' ' 

How much in^jortance shouldyte gv '&ci to all pupil dala? 

How much importance should pupil datk collected with this package 
be given? ^ 



How accurate are .pupil perceptions? 

How careful and honest are pupils in conrpletirig questionnaires? 

Should we respofid by giving pupils more of what they perceive ^as 
being needed, ^ty to- change their perceptions of what' is needed^ 
or ignore their perceptions unless they coincide with ours? 

It should be' kept in mind that this package cannot be used as -'-^ 
an evaluation tooi» It would also' be dangerous to use the data col- . 

/ \ ' . ' . r ..... ..... .. . ^ 

lected with this package as the eote basis for planning program changes. 

If" this project is to be iraplonented',- i't'i&' important that school 
administrators commit themselves to respond positively to any^nfeeds • 
reported* and to convince the pupils that their views will be' taken 

In addition to making the necessary commitmeht in terms of time, ^ 
money, personnel and effort, 'one, individual must' be appointed to tal^^ 

ful> responsibility for coordinating the project. This.person i^. re- 

, ■ ■ •■■ s ■ ; ' • 
f erred to as the "Project Manager" in {this package. , To, coordinate the 

project successfully, the Project Manager must be given the authority 
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needed to acconplish his tasks <md be provided with the time, budget, 
and persoimel needed do his job. 



USE OF PPNA INFORMATION 



Pupil -Perceiveet' Needs Assessment iAformatidn can help personnel 
at various les^^ls of - the school organization, depending on the sitda- 

» . f 

tion: ' ■■ ' ,■ ' 

■ ■ ' ' ■ ' . ■" % / ' ^ 

- Pupil -Perceived Needs Assessment information can make the 
alaesroom teaoh^p sensitive to the perceived needs of the pipils 

• in his/her classroom. > , ' • • 

. ■;, ■ - ' ^' ■ ; "/ 

" Puf»il-P*erfceived Needs Asse^^ent informatio]^ cah inform the 
soiwoZ pHnoipat Bbout^fbm^^~l^^ 
blinding level. 

- Through systematic analysis of -district Pupil -Perceived Needs' 
Assessment infonnatipn, together with other 'da,ta from tefchers, 
parents, principals, conimmity leaders, etc., Bohoot dietHot 
aMnie'ti'atoTe twci dov^lcfp '-a. sound basis upon which to base 
decisions related to district-wide planning and improvement y 
effdrts. ■ . ' 

Pupil-Perpeived Needs Assessment can also supply: . , 

- Baseline informatioh regarding, the reactions oif pupils to ongo- ^ 
ing programs and activities within a sdhool..- Information of ' 
this kind can be used to establish standards against i^ich sub- 
sequent changes may be evaluated. 

' - Information on program strengths that can be further developed. 

- Infonndtion on program weaknesses that can be corrected. 



- Information on changes i^t are being or* have been .implemented . 
in a school* Pupils' perceptions of such changes can reflect 
the effects of the changes on the pupils, themselves. The direc- 
tion, that in^rovement efforts should 'tto ftay also be indicated 

/ by this information. . . .. 

" In format ion that helps to clarif y a suspected prob lem, or prob- 
T.ems, already" evolving in the sdiool district," the causes of 
' which ar^ unknown,; ' ' 

- l^giy ideas for school activities. 
^ " - METHODS TO COLLECT gPNA INFORMATieN 

. • . , ^ . . < , ■ / 

^ The collection of 'this vaXyable information frcan students cannot , 
be left to chajfice. ^ While many ptqails at« wiUiiig. to express theirv 
feelings ajbout their educational experiiesnces, iiifoimatibn obtained 
through uiiplUniied procedures is generally of little value. If '-expr^s- 
^ 5ions of pupils • f^^lings are to l?e useftcl, a systematic irtforntotion. 
collection approach is needed. : 
The methdds or appr6ac;hes most commonly used to obtain data froin 
res|)ondents are interviews and questionnaires. ' ^ , i 

Compared to an interview, a questionnaire is less escpensive, is 

, , ^-^ ' ■ • •' " ' ; • 

mUch easier to admini'sterr and can be given to a large number of re- 
spondents simultaneously. The iinpersonal nature of questionnaires 
allows respondents to express themseivfes more freely^ subjects them to 
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less pressure since immediate responses are not required,. and insures 
some 4egree of uniformity froin one measurement situation to another.* 
The questionnaire approach does require that Tespondents have a certain 

level of read,ing and/or writing ability; however; considering the > 

' '• ' ■ . " ■ - ■ • 

school enviTonmenlrtvhidhr the Pupil-Perceived Needs Assessment is de-' 

signed to measure (from the third grade ijp), the questidnna|re approach 

is more desirable tiian tjhe intervijw Approach. (With pupils wlib ,do not 

have third grade reading and/or writingXability, questionnaires can.be'"^ 

* administered ^ijally. "Administering questionnaires Orally proved suc- 

cessfulftWhen this package was field tested.) - ^, • . 

The Pi^iUPeraeii>ed Heede A$3&e0ment in^iaatd^^^ 

used in Pupil-Peraeived Needs AQaesemmt^Hs uemlly a qu&itionmir^ 

(mHng-eaalei open-tended, or mixed) , designed by edhool pevaonHel to 
. ' " ' . . ' ... . . .. . ■ 

' obtain data on pupila' feelings, attitudes, and opinions in -whatever „ 

areas are of -prime oonaern to t%e sohoot/distriot, 

' " ' ' ,. - ■ . •' ; ^ ■■ ■ 

; , Rating-scale qiiestionnaires list, statements or questions with a , 

sdt of answers provided for each item or question; the respondent indi- 

cates his response by circling one of the answers supplied for each 

item^r question. . Answer scales are usually continuous in nature. 

For !j8xample> bhe scale miglit indicate th^ degree of agreement/dis^gree- 

ment with each of 'a" series of statements. 



Open-ended questionnaires contain questions to which the respon- 
dents 'simply vrritten answets in whatever form, length, or detail they 

' Mixed quest ionnaires cgntai n-bo th' rating»scale and open-e nded 
items . * ' • , . - , 



SPECIFICATION OF AMNISTRATIVE CONSTRAim'S^- " 



Three possible administrative constraints should be consideted "* 

0 .. ' . . . ' . 

before a decision to<" implement a PPNA. project can, be made:'* these 

constraiiits invblve^^^^^^^ • ' 

. ■ \ - ' ■ ■ ' , ■> 

The time required for a given PPNA project can vary widely, depen- 

ding on the many factors involved, e.g,.., (1) ^desired pupil sanple/ 

V • ■ 

(2) type of PH^ indicator selected (rating -scale, t)pen-ended, or . 
mixed), (3) number of indicator. items needed, (4) desired quality of 
the indicatm', (5) experience of the staff involved with similar tasks, 
* I:(6) method of administer iiig the indicatoi; (written or oral responses, 
pre- and pos^-administration, etc*), (7) urgency qf tiie project, etc* ' 
A PPNA proj'ect does not necessarily require that school district pet- - 
sonnel devote inintemqpted segments of time to it, i.e., whole days or 
whole "veeks. If staff members are only available after- school hours, 
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the project can be accoiii{iXished by a cumulative effort which will take 
more time. If the project is to be implonented as a cuimlative effort, 
extra time shouB .be allowed for the various' activities vfhen the sched- 
'Ules or time lines are bel*.j-est3)lished. > ^ 

, 5._ . ^ _ ^ , 

: ' v The main ooet items in a .PPNA project involv^ developing the in- 
dlcator, reproducing it, processing pupil responses, and analyzing the 
data, TVnother likely cost item is coinpensation for the personnel ' in- ^ 
Volved, but /frequently this expense dsn be avoided by iuipleihenting the 
project as an in-service training program.. r . : ' 
. r Pevsonnel availability might iiirpose 'ano'ther constraint. Appropri- 
ate personnel should be ii)volv^d in eabh proj'fect' task; for iSistance, 
the people developing the'pPNA indicator should be completely f miliar 
with' the curriculum- or prdgram being assessed; the people responsible ' 
for drstwing the sanple should have training . or experiencej4n_sa^ 
etc. After you have identified the, most appropriate people for(iach 
task, as Project Manager, you should find out when they are available 
so that time ca;i be scheduled for them to peicforrri the tasks involved. ' 

•Estimates of the •cime, cost, and personnel requirements for a 
PPNA project of moderate scope are given on ''the feliowing page. These 
estimated are provided for each of the major tasks involved , 
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Consider your constraints before deciding whether you will be abl6 
to implemenl; a PPNA projects 



* TASK 



TIME* 



1 . Developing a PPNA In- . 4-6 houfs 
dicator (includes re- : .r, 
producing the indica- ' ' 
%) 

2. Administering .the PPhlA l/class 
^ Indicator - • p'erlod- 

3. ^ Processing PPNA: Indi- , 4-6 hoiirs 

cator Data , (includes x 

Summarizing^ the .data) ^ ^ 

4. Analyzing and Report- 4-8 hours, 
ing PPNA Results ' 



COST 
O 'tO $100, 

no cost 



PERSONNEL ■ 
3-6 people ' 



My number of 
people 



0 to $200,. •2.-S people (cm" 
piiter services , 
. , may be used) 

0 to $120 1-6 people ' . 



5. Sampling'** 



4-8 hours' O to $40 . l-2.people< 



Taking your adminiistrative constraints into consideration, have 
you decided to iirplement a PPNA project?^ If;2/ee, continue reading. If 
stop here. , , 



> . ^ *ltie tune, estimates here show the actual time needed per par- 
ticipant for each task; the duration of the pix)ject, however, could 
vary from one to tm fnonths; ^ ' ■ \ 

**Activities related to sampling' can be calrried out while the 
Project i^nager i J planning the fPNA project. 
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DEFINING ™ POiyOSE OF THE PRQjm ' , ' . / 

' /' ' * ^ ■ 

In prder to plan a PPNA project/ it is necessary for school dis- ' 

trict personnel to, first define th6 purpose of ; the project in. terms of 

informarion-froiTi pupils"!^ needed, .. It might be valuable .lib l^ow' 

how pupils feel about a'speaific curriculum area, for exainplei either 

because pi^jii outcomes are low or because attend&ce in* those Classens 

i,|poor. My qualifying cons'iderations such as eurriculum,..progr^, 

grade levels (or a^e groups) , ;pupil population involve^, tvhich ^pply . ' 

should also- be specified. For example, suppose thaj: there has bpen 

ain increase in classroom disturbanGes in a junior high rschool. In thi^~ ^ 

case,- the pu^ose defined fbr a PPNA project mi^ht be '^to identify the 

causes of the classroom disturbances as perceived by the pupils." the 

pupil papulation involved would include all of the pupils in the school. 

Specifying a curriculum area w6uld noli, be appropriate, „;siiice this prob- 

. . ■' ■•- '■ ■ \ " " • 

lem cuts across 'all curriculum areas. 

■ ■• / - ■ . : ^ - _ , .. •' • 

In addition to the above infonnation, you should also specify 
my comparisons that are going^o be Mde. For exalTt^le: Do pupils ' . 
prefer the new books to the. old ones? Do open classes generate better ■ 
■attitudes toward school than traditional clashes? Do minority pupils 
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feel excluded from activities althowgh other pupils do, not? Some com- 

^ J ^ * ' ' 

mon kinds of comparisons are : . , ' . <> 

Be^f ore-after comparisons : . Cdmparing the scores of a' groi^) of 
pupils before an event with their scores after tJ^e event. 

' Cojfiyarisans" of 4ifferent~'EreaenetoT ~~€ong^ 

group, of pii^iis witn those otVanother group of samilair pi5)ils 
receiving different (or no) instrucl^ibn. ' (For exan5)lei comparing 
. differ^t" Reading programs.) ' . • ■ ' > . 

" ' i, ' ' . ■ '■ . ° . . • . , ^ 

ComipafisonS betv/een subpopulat ions ; Conqparing oiie sub'grotp of ' 
pi?)ils with the ^tire group or with- another svbgraup. (For . * 
' ■ example, comparing black pupil attitudes to white 6r Chicano' 
attitudes.) - . . * ^ 

' ■ . ' ... • , .s . . .. > 

• Your projedt; could be designed to iijiclude, one .or more of the- kinds' 

_ < > • ' . .1 , ... • , • • ■ 

of cdijpparisons outlined kbove. , ' , ' • ' ' 
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■ Abmmidjjf sheet 



- Indicate below the purpose of your PPNA project. ° Ii/addition to 
detailing exactly why. ^is information is needed, be sure that curricu- 
lum, pig?grajn, . grade levels, (or age groi?)s), pupil population involved, 
and any co roparisonsf to be drawn are specified, if app licabl e. 



1, .Puifpose of thg project? . 



I ' r, 

— 4u 



2. . CXiiTiculimf (and/or program) 



1/ ■ .4' Total piipil population invplved 



» Schools' ' 



' Population 'Breakdovm > - 

Grades CMfes) Classes' SubtQ:tal ^ ' 



\ • 



4. Cojnparispns to be drr^ 
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DETERNgNING INDICATOR iSPBCIFICATIQNS 



As Project Manager, you need to jhake several decisions at this. timp 
regarding various general aspects of the indicator .vfliich, in-tium, will 
affect both cost ^d time consideration?. These decisions involve, three 



different elements: "^he type oC iiidicator to .be used- ^rating.- scale, 
open-ended, or mixed; -tjie" length of the indicator; and: the method of 

». » - ■ <V . . o • , . . . 

development, i.e., jvhether yoix use an existirig^ instrument or 
develop your own indicator. These considerations will be discussed in 
turn. ■• ' ' \ - . 

DECIDING ON THE -TYPE QF..INDICATO ! ' " 

- ! following questions have been compiled, to assist you in deter- 
irtining whether to use an open-ended questionnaire, a rating-scale ques- 
tioiinaire, or a mixed questionnaire. ■■ 

e 

Check <\/) yes . or ip for each question in the appropriate column 
on the. right. The meaning of each shape will be explained, on the " * 
following page. ' ' , . 



J' 



c 



Yes 



No 



1. Do you want to collect very specific 
information^ about the^lrea of con- 
cern? ' ' ' ', 




Yes 



No 



2. Do you want the piipils' responses 
to be minimalXy° influenced by the 
way the questions are jasked? 



3. Will- enough qualified volunteers; - 
toacher^, or other^ staff memh'=jrs 
be available to score the ind 

tors? ^- : , ' L : 

4. Will pupils' oiiinions e3q)ressed 
. degree of lilces and dislikes be 

sufficient for your purpose? 



S. Are the pupils' writing skills , 
adequate for them , to exptess^ them- . 
• selves (at least tKird grade level)? 



6. . Ard you so limited by .the time 
available that processing the 
. indicator? is a serious problem 
(a week ot less)? 



□ 






o : □ 
□ 




The ^ checks marked iii the equaree indicate a preference for the 
.rating-scale format. The checks in.the dirotee suggest using an optii 
ended indicator.' Any responses in a airatefineide-a'Square should be 
ignored, since they do not specifically relate to either form. 

' If neither fcype of questionnaire^is strdngly indicated, ^'indi- 
cator containing both rating-scale and open-ended questions may be the 
— tJest kind of instrument for your proje^v. Of coCirs other -factor?. 



such as availability .of exiisting indicators, may influence your deci- 
sion. (More .detailed discussion's of these factors are supplied in 
l^it-.20 • •• e ' . , ' 

• ' C 't 

DECIDING ON TO LENGIH OF THE INDICATOR • 

" ' ' " -I -I I.I .1 I I nil -.11 I mnami ^ 

. The length of the indicator will depend on the amount of informa- 
tion needed to fulfill' the stated purpose of your ?PN/V project. Also, 

the^timo required ta administer the indicator should fit into a typical 

'. ' 

class period. For the lowest grade levels, the period of administra- 

* ' *' "• • 
tion generally should not exceed 30. minutes, with no more than 20 min- 

■■ ,. • •■ • V • , ■ * 

utes allowed for resportdii^. Thirty or 40 minutes should provide ample 
time for pupils in the higher grades. . . • 

Generally, the time allowed to ''administer a given indiqator will 

* ... 

determine how many questions can be included. Since it takes longer 

to answer an open-ended question than a rating-scale question, an open- 

' ' ' ■ \, 

\ended indicator 'usually contains imer questions "than a r^ting-s<?ale 
indicator. . , 

DECID ING ON IHB METHO D ^OF DEVELOPNENT 

The final basic decision to be considered is related to how the - 

V . - . . 

indiV:ator will be developed. You may wish to vse an existing instru- 
ment, modify an existing instrument, or construct an entirelyHew one. 



Yoa may wish to confer 'wifh dtie or mor^ persons with special training 
or experience in this area* Saiie. sources vAiich provide information on 
.. existing instruments are listed in Unit 2. If you are considering the 
use of an existing instrument, however, be sure that it is appropriate 

■ 'i . 

'for the grade level and program being assessed, If possible, try to- 
develop an indicator for your PPNA project— you are mo^t familiar with 
the local situation and knciv what kinds oi information you want to 
' collect from the pupils. 

If, at this point, you are undecided as tp which method 1;o use, 
postpone this particular decision mtil you reach Unit 2, just before 
the actual development of the indicator. This decision does not have 
to be made now. although' once it is made it will '■have a. significant 
effect on both the final results of the project and on the cost of the 
project in terms of the development time required, 



S8 
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^* 3!^:£g:0:g :Indicator Cming-^scale? Open-ended? Mixed? }^ 



*■ t il I i m imm i jf , u m\ 



B. - Length of Indicator (How long will it tak^ to administer the indica- 
i:or/ Ho\f many items will be included?) 



c 



^' 0^ figjfQlSga!. (TO'tise exi3t;^jig instrument/it#ms? lb con- 

^ struct your Own. instrument/i' -J) 



0 ■ 



f 
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TASKS INVOIVED IN PPNA 



Haying specified the administrative constraints, defined the pur- 
pose of the project,' determined the type and length of the PPNA indica- 
tor, and peHiaps also the desired sawple" sisse,* you need to develop 
^ overall plan for the project. ,Hence» it is ijnportaAt at this point 
that, as Project Managed, you familiarize yourself . iith the tasks 
involved in the project. The. five most cricial tasks are described 
briefly below. 

. • ■ ' • • 

, (I) PXaiming .a PPI^ Project. O^re ^specifically dealt "With later 
m this unit.)' . ' • • 

In performing this task the Project Manager will acquire all ' 
" 5 ^ • information needed to carry out.'pr'eparatory activities 
Td^signed to facilitate the .performance of all subsequent tasks. 

(11) Developing a PPNA; Indicator, (More specifically dealt with in 
unit 2. J " — ^ — , 

This task involves develbping a Pupil-Perceived^eeds Assess- 
ment indicator aptropriate for collectijig information on the 
defined area of concern; The- PPNA indicator is usually devel- 
t> oped as a joint effort by a group including teachers, curricu- 
lum specialists, -and principals. • : 

(Ill) ^j^l^^g^^g^^Je PPNA L^^^^ (More specifically dealt 



w^^!!^^f ^ Supplement for information designed 

to assist you m^deciding whether., or not to use a sanple and, if \ sam- 
ple is to be used, how large it sht)uld be, . 



Bo 
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Teachers or other staff members administer the indicator, to - ,: 
the pi^ils- and collect the indicators at the end o£ the 
, administration period, 

. (IV) Processing FPNA Indicator Data, '(^fory specifically dealt with 
^ in Unit 4>)^ v . - ^ • v - ■ 

* ■ ■ . u ■ 

e 4 ■ 

The P)PNA ijidicators are proces.^ed and the data collected are , 

sunwarized. ' . , ^ 

. . < * . • ■ • 

. (V) Analyzing and Reporting PPN/V Results • (Nbre specifjically 
dealt vdth in IMit 5.) , ; ^ 

. '1 

A summary report is prepared to be submitted to the appropri- 
ate personnel and juministrators for their review* 

In the following section, specific activities or subtaslcs are , 
listed under eaich of the five tasks mentioned above to give you an 
idea of the overall process. This outline .will be a helpful reference 
throughout the assessment process. , ' . . 

Task I - Planning a PPNA Project , 
A. Information needed by; the Project Manager 

1. What is the purpose of the project? 

2. How large is the total pupil population involved? 

3. How much time is needed for jUidicajtor development, 
reproducjtjxjn, pac1<aging, administration, processing, 

' and re|Jorting? 

4. How large a budget is needed for this project? 

5. How many participants kre needed for the group which 
will develop the indicator? 




mmmmmmmmmmm 



6. What information is needed about per&bjmel who could ^. 
appropHately develop ^d^^^\M^^^ 
tor (subject matter, gi'ade/level, etc.)? . / 



B, Activities for the Project ^fenager 

1. Determine sanple si2e. (^ee the detailed information 
on sami>ling provided in^^Section I of the Supplement.) 

, 2* Develop a tentative task schedule and time flow for 

the project, 

« . 3. Estimate costs for 't)ie project. 

4, Establish a group to develop an indicator, if neces- 
sary. ■ ' . ■ 

5, Arrange for the location, time, and facilities for 
. • group meetingSi, ^ 

^. ■ . ' ', ' ■ . . ■,■ ■ . ' - 

6, Arrange for; pilot testing and revision of the indica- 
' • tor during the development 'phase, 

^ • • . ■ ' 

7, Arrange for printing, packaging, storing, and dfs- 
" ' tributing the indicators. * 

8, Arrange time, plac0, and procedures for administer- - 
ing the indicator. 

V ■ 

• * . ■ 

Task IX Developing a PPNA Indicator ' . , 
A. Actual development of the indicator 

If a gmup effox*t is planned, the group members should 
discuss the development task with the Project Manager. 

1 . The Project Manager assigns specific responsibilities 
to group. members. 

2. The Pi'oject Manager distributes supplies and resource 
• materials for use in the development effort. 



/ 
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3t The groi?) deci4es whether to vise an- existing indiqa-* 
a tor or to develop ttor own. * ' ' 

'4 . The groi^) develops prototype questions , an answer , - . 
sheet^ aSid jiecessary instructions. ' ; 

5, The group atidits the prototype* questions.' 

6. The questions, are typed out" and proofread.- (Tinte 
for replyinig tp each question, sequence of ^questions, 
spacing between questions, etc*, are considered.) 

Pilot -testing the indicators ^ ■ 

The indicator is reproduced for pilbt testing on a small ' 
group of pupils who are' not members of the sample groi;^. 
li is suggested that an evaluation sheet be attached to 
thfc indicator or that provision be made for oral fe^- 
back so tHat these pupils can comment on the indicat9r 
to help the developers determine how useful it is in 
terms of achieving its purpose. 

Revision of the indicator on the basis of pilot test 
results, if necessary. If revisions are, 'extensive, the 
revised indicator may have to be pilot tested. " 

Reproduction of the revised indicator for administration 
to the population or sample to be tested. - , | 

Administering the PPNA Indicator x 

Each participating teacher should receive sufficient . 
copies of the PPNA indicator for his class before the 
scheduled administration time. 

The teachers should read the directions for giving the 
indicators before administering, them. If they have any 
questions, they should ask the Project l%nager. 



C, The teachers . should make sure that .;every ,injpi;L, h^s ah i 
' ' ' indicalSbr and a. pencil and understands liow to respond,' 

where to entep his responses, etc. . ■• 

' ■. • ■ ' ■ , . " 

D, " The teachers should be Available to answer any pupil j 

questic^ns during the administration period. ' 

, . ■ ■■ » •. .• '. . ■ 

the teachers should collect all completed indicators . 
. . from the pupils, at the end of the administration period. 

, F.- All completed indicators should be delivered to the 
Project Manager for processing as soon as possible* 
Unused ijadtotors .should also be returned to the Project 

» Msinager. ^ ' 

Task IV - Processing PPNA Indicator Data ' 

A. eiear, step-by-step instructions on how b sanple, code, . 
tally, or categorize the data should be provided to the 

. ■■ ^ ■'■ people who are to jirocesS' the data. ' , 

B. The Project Manager should superidse the processing of 
the indicator data. ' 

C. ITie processed data should be reported in a format which 
will be understandable to any selected audience (s). 

Task V - Analyzing and Reporting PPM Results 

A. Having received the results ,„teacher,s and/or other appro- 
priate personnel analyze the results and prepare a report 
on the area of concern involved. 

•* • . , * • - « 

'The foregoing section provides a rather detailed outline indicating 
what the project involves and what activities you, ais Proj.ect Manager, 
should anticipate. In the remaining sections of this unit two critical 
activities are discussed which you will "have to perfoirm in, connection 
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with Taslc I; (a) developing 4 tentative task scAedtile and "time flow 
for the project and (b) preparing a project -related ccit estimate. 



1*6 



• ' TASK SCHEDULE AND TM P LOW f 
. Three exanples ara provided on the following pages to show some 

► — • • . ^. ■ ■ • 

possible formats for presenting a task schelule together, wi-^ a time 
flow. Example l"page 1-25) shows the fxvje .najor tasKs, indicates ^ 
the personnel responsible for e^ach tasK, and provides an estimate of 
the actual time required for each task. Examples ,2 and 3 (pages 1-26 
and 1-27) present the project tasks in terms lof two time flows using 
different units of time (one is given in weeks and the other in days) . 
A time flow makes it possible not only to set milestones for specific . 
tasks bMt also to envision the total time required foi* the project 
by showing how the time estimates for each task relate to other ongoing 
programs or activities. • 
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TteTIVE TASK !5CHfeDUI.]B FdR A 



PUPIL-PERCEIVED NEEDS 



PROJECT 



1 ' TASK 


* •• . — / 

RESPONSIBLE ^ ' 
PERSOm 

♦ 


■1 , . 

^ TIME 
, ESTIMATE* 


I. Planning a. PPNA' 
Project 


Project ^^anager 


1 dav 


11 ♦ Developing ^ PPNA 
IndicatCr 

^ — ■ ■ ' 


.■' 

1. "Project Manager 

2. Development group 

3. Printing- unit 


2 days 


in. Administering the 
PPNA Indicator 


'■■ ' "' — : — "'y „' ^' 

X. Project ^|fanager - 
2. Participating 
teachers 


" 1-2 class periods 


IV. Processing PPNA 
Indicator Data 


1. Project Manager ,* 

2. Data-processing 
personnel/agency 


- — -■'•'kp ' ^- ■-■ 

3-5 days ' - 

• * ♦ 


V. Analyzing and 
; Reporting. PPNA ,. 
. Results 


1. Project Manager 

2. Parti9ipa1;ing 
teachers 


1-day V V 



*The time estimated for each task is an average based on experience vdth ideal 
school districts. Tl^ time, required for each tasli can var>' greatly. * depending 
on the 3cope o£ the project. . / » n » 
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SAMPLE TIME 5IX)W FOR PUPIL-Pm(iiVED NEEDS ASSESSMENT TASKS 



. (BY 



TIME AVAILABLE: " 10 VCBEKS 



37 



WEEK 

. • T/^ T^*---^,.....,^^ 


1 


2 

V 


3 

0 


.4 


s 


6 

ft 


7 


8 


9 


10 


I. Planning a PPNA 
' Project 






& • 






* 










-r-i ^ 

II; Peveloping a 

PPNA Indicatpr 
> ' (includes pilot 




[■^ 






• 






4 






III. Administering 
the PPNA Indi- . 
cater - 














<^ 


\ 






IV. l^tocessing.the 
PPNA Indicator 




















■■ / 

■/ 

/ 

/ . 

•/ 












. V. Analyzing and 
Reporting PPNA 
Results s 






1 








<> 




7 

,/ 





/ 
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EXAMPCE 3 / ■ . . ' , 
SAMPLE nm Fm VOR PUPIL-PERCEIVEiD NEEDS ASSESSMENT TASKS* 



, . • ' -/ (BY DAY) 
TiME AVAILABLE: "oNE WEEK 



. TASK ^''""'''''^"^--^^^ 


1 


2 . 


..3 , 


/ 4 


^ 5v 


•I. Planning a PPNA 
"Project 






♦ * 

V 


id 


_ — L 


II. '^Developing a r V 









\ 


* 

* 


III. Administering the 
. PPNA Indicator 

— — ■ — - — - - - 








% 




IV. Processing the 
PPNA Indicator 
, Data 






< 

* 






V. Analyzing and Re- 
porting PPNA- ^ 
Results ' • 

V 




-ew.- V- 


1 


t 





'^The time require<J for con5)leting a given PPNA project will vary dras- ^ 
t^cally depending on the scope o£ the projects The diagram abbve il- \ 
lustrates an extranely limited project where only four and a half days " 
are needed. .. Tliis could be a situation where an 8th grade Algebra teach- 
, , er wants to collect feedback on a new teaching method. In a case like 
' this,' the teacher can actually haiidle every task himself to collect the 
information desired. • • 

D?r> " 33 ' 



* ■ . •■ ■ . ■ 7 ■ 
* - . ' ' ' ' .. " " ' ' " ' ■ , ' ' " ' f ^ ■ ■ ■ * 

In order to develop a realistic task scheme au^ time flow, ask 
yourself the follo^diig questioi^ . 

1 V Have; starting and^ ^ding dates been specif i^d^^or the 
.• ;„.pi8»ject?' . \ ■ . • ■ ' ■ * ■ 




. '2. How lisng villi it take to: 

ra. develop an indicator? ; ^ - ' / 

' ) ' b/' reproduce thfe indicator? ■ 

' pilot test a^^^^^ ; 

-d. adndi^tster the indicator? . 

" •- ; - ■ . '. ' ■ . ' . • " ■ ■ ; ' ■ ■ ■■■ 

' . e. process the indicator data? ' » ^ " 

, ' ^ ■ ,f» analyze and report the resultsr 

3, Mien will the staff be ayailable? 

4. Do vacations, holidays,, or other school -related functions 
\., , extend the period of t%m fi^eded to Jinpleanent the project? 



* * * 



, , 'V8& ^xAOTk^etfm m fotloidn0: tuk) pages to develop a tenta- 
ttt>e tadk^aaUme csnd time flota fov yc& -pvogeot. ^ 

" ■ ' ■ 

The, dmoHption fof eaoh task tieted on'pages 1^20 to U 2$ aM the 
task aahedules and time flows presented on'p&ges U2B to U2? 
should help you in estdbUsHng time tines foi> yotw project 
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Now that tentative time lines for performing the tasks involved, 
in the project have been developed, you are better able to develop a 
jnore sophisticated cost estimate on the basis of the various expenjses 
involved in iJiplementation. TTiis section gives you an opportunity to 
develop a cost estimate for :\e prdject, talcing budgeta-y constraints 
into consideration. • 

If costs are not a problem^ twm to page 1-43 for a. svmary of this 

unit. 
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PREPARING A POST ESTIM ATE 

The expenses related t6 a' PPNA project n^y or may not involve new 

or additional costs in terms of the district budget. This will depend 

$ 

on the size of the operation and how the project relates to overall 
.'school system activities. If the project only covers a small area of 
the district or has become one of the regular activities of the school 
system, the costs will probably be covered as regular school expenses 
(e.g., teachers do not require additional condensation for their par- 
ticipation; a printing machine is aiV'ailable to reproduce the indicator 
at ' no extra cost ; paper , pencils » and pther mater iai§ can- be supplied 
from existing school stocks; secre'tarial services are available; etc.); 
in a case like this, a project will require practically no additional 
budget. On the other hand, if a project involves a large staff , requires 
large quantities of materials and supplies, and outside clerks are need- 
ed to score indicators, etc, a special budget \nll have to be set 
for the project. In either case, decisions about the scope of a project 
will have . » be made by the central office administrators. 

When a project involves new expenses for a district, an estintate 
of total costs should be prepat*ed. As Project Manager, .it is your 
responsibility to estimtite such costs by category for each task. 
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The categoric? to consider incltide costs related to personnel, materials 

and supplies, reproduction, data processing, and any other e:q)enses in- 

• ■ • .» ■ ■ ■, 

volved. . ' 

Suggested procedures for estimating expenses by cost category are 
discussed l)elow: 

PBRSONNEt 

Personnel costs are the most expensive budget item in any assess- 
ment project. Participating personnel include the Project Manager, 
principals, curriculum specialists, teachers, typists, scoring staff, 
etc. The' cost estimate for this item vdll depend. on the scope of the 
project as well as on the duration and the nature of personnel involve 
ment. if a project is limited in extent, it is probable that no separ- 
ate budget will be needed; teachers or interested parents could 
volunteer to perform the -essential tasks without any extra expense be- 
ing-incui^-ed. In other situations, ;vhen a project: does involve exp^es 
over and above the regular budget, estijnates of howlj or daily pay for 
the personriel involved are essential. 

/ ■ 
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The following formula is suggested for estimating personnel costs; 



Estimated 




Estimated 




Estijnate4 




Estimated . 


Average 


X 


taber of 


X 


Number of 




Personnel 


, Hourly 




Hours 




. Staff 




Costs 


Rate 















This infoxination should be calculated for each task. 



MATERIALS AN D SUPPLIES 

— n~i'i - I I III J * 

This, cost item covers any books, stationery j typing supplies,- etc., 
that may be required for the project. It should not include costs for 
reproducing the indicators, as this item is handled separately. For 
most district|, however, no costs will be incurred in this category, 
since the materials needed will be negligible "in terms of normal dis- 
trict supply requirements. 

REPRODUCriON ' 

You will need. the following information in order to estimate the 
cost of reproducing a Pupil -Perceived IJeeds Assessment indicator: 

1. A rough estimate of the total number of pages involved, ' 
This ^figure can be calculated using the following formula. 
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Ntonber of 
Pupils 
Involved 



Number of 
X P^ges for 
Inclicators 



T 



• Kumbesr of Numbet of 

People 0 5, Pages of 
Administering Instructions 
Indicator 



Estimated 

In^tal 
Numlieiv of 

Pages 



V 



2 . A rough estijnate of the 'costs related to different print- 
ing processes. The diagram on the next page provides 
brief evaluations of four reproduction ptocesses in terms 
of availability in the school district, cost (approximate 
cost for 1000 copies of one page), and speed.* All esti- 
mates ar^ based on, the, experience of Research for Better 
Schools, Inc. . 

\ 

It is suggested, however, \hat each school district col- 
lect Its own cost information on various printing methods, 



.1 , • .■ ■ ' . 

. *The diagram on pafee 1-36 will only be meaningful in schools/ 
districts where .more than one process is available. 
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total iiuitiber of pages needed can be figured out^ district per- 
sonnel will be able to determine the niost cost-effective method 
^or printing ^eir indicator once cost estimates for the various 
methods are available. 



mam of 

1* Wtto 



AVAILABIUW IN 

soipoL msnacrs 



A (X»]PARI^ OP j<m AtiT^TIVB HBF^ 
OOST FACTORS^ 



method 



24 MiJiKBOgnqph Second in avails 
abilit/ 



3. Xerox 



'Less frequently 
available * 



4. 



^^ultilith- 

offset 



Generally aiJ^ail - 
able only in 
litrge districts 



A. \ Bnquires a machine to pre^ 

pare roaster. 

B. Paper costs apprc«eiinately 
$1.40!^per ream. 

C. Ditto Master l$^ 

A. Master stencil may be pre- , 
pared by- typistJ)ut not/^il 

masters can be typed. In 
these instaiices a machine 
can cut the stencil . Cost 
p£ stencil i$ 20^ but labor 
costs could be high. 

B. Paper costs approximately 
$1.25 per re^im. " 



A. 



A. 
B. 



Varies depending on model. 
One estimate is 6^ per 
page* 

' Masters cost around 6V each. 
Paper around $1.60 pfi$ ream. 
Print shops may clmrge about; 
6i per page for 100 copies 
5^ per page for 250 copies 
4^ per page for 1000 copies 



*^\\11 costs depend on €he sixe of 
the job and often on the nwbet 
0? jobs. Discounts We avail* 
a jle ftotti print shops for large 
jobs. 



APPRDXiMATB COST FOR 
lOOQ OQPIBS OF ONB PAGE<»» SPBBD 



$2.10 



$2.70. 
♦ labor costs^ 



Sloif and 
messy 



iZSOO sheetifi 
per hour 



$60.00 



$3.26 



Depends on 
model 



eooo-^sooo 

sheets per 
hour 



**A11 processes involve labor 
costs but stencil preparation 
can be quite expensive. 



DATA PROCESSING ' . . 

After the indicators have been administered, they are colleoted 
for processing. Different^.tecMques are available for processing data. 
Critical factors like time, space to Accommodate working staff (if manu- 
al processing is considered), costs, confidentiality of data, objectiv- 
ity of evaHlators, and scope of operations (the number of participants, 
number of Indicators to be processed, etc.) all will affect the decision 
on which data processing technique to use. 

The data from both rating^scale and open-ended :hidicators can be 
. processed manually or by computer; however, cost -effectiveness should ' 
be considered when making t^s decision. Since personal judgment will 
be, an el^ent in processing open-ended items, the objectivity' of the 
evaruktors, inter-evaluator reliability, and the number of evaluators. 
needed must be considered. 



OTHER 

This itm is included to cover any special costs such as mailing 
for data collection which might not have been anticipated. " 
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The^ thirteen statements listed belw relate to pos^^^ 
involved in a Pupil -Perceived Needs Assessnient ^roje^^^ Pill in the 
blanks followii^ each statenient; with the eiq^ropriate task and cost (see 
outline of taslcs on page 1-19 t;o 1-20) catefio^ty or categbries 
1*33 fer the cost categories involved)* * 



I* Three^ teachers volunteer to 
spend 3 hour^ after school 
to develop an indicator. / 



Taslc(s)_ 
Category^^ 



(or categories) 



2* A teachers* conference, room 
has been reserved for use 
during indicator development 
as well as for scoring ahd 
tallying the indicator data. 



Task(s)^ 
Category 



(or categories) 



3. All of the teachers are so 
occupied with their work 
that the district has to hire 
consultants from a nearby un^-- 
versity to/develop an indica- 
tor. 



Task(s);^ 
Category 



(or categeries)^ 



4 ♦ A contract has been sij,... _ 
between the school district 
and a cwnputer data proces- 
sing ccanpany for the pro- 
cessing of indicator data. 



Task(s)_ 
Category 



(or categories) 



4g 



Th© Project Mamger estimatM: 
th6 costs for tjie PPM pr0i€^^ 
mid contacted school porsGnnol 
to participato in the project . 



Cate^ory^ 



(Oia (jategorles) 



jft was ciecide(l to draw a sam- 
ple of 3 classes fiOim 
grade (3-i2> for administer- 
ing the PPNA indicator . ' 



Ta^k(s)_ 
Category 



(or categories) 



Four conscientious senior high 
school students volunteored to 
score the indicators of the i 
eleroentary school piitpifc on' 
History. v 



As a result of a parent-teacher 
meeting, parent representative^ 
ar^ eager to see the results of 
the PRw project and * tjquest 
copies of the sunmary report. 



TaskCs)^ 
Category 



(or categories) 
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Task(s)_ 
Category 



(or categories) 



A task force of teachers is so 
^interested in the project that 
t^iey want to administer the 
indicator on a la-e- and post- ' 
test basis. ' 



Task(s)^ 
Category 



(or categories) 



Th^ first draft of the indi- 
cator is pilot tested by 10 
students. 



Task(s)_ 
Category 



(or categories) 



it. 



^0 
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11. Bach participating staii 

inembor^Is ^skea to give a copy 
of his schedule to the ProiJect 
Manager so ti.;^t he cah pac^re 



a working agenda for 
ect^ 



the pro 



Ta9k(s)_; 
Category 



(or Gat^ories) 



■•■V- 



12. A teachers* guide is prepared 
to give the teachers who will 
adminisifer the indicators 
instructi^ on catrying out 
this task properly. 



13. The llistory curriciilum co- 
ordinator was given the re- 
sponsibility of ccordinatiing 
the entire PI^NA project. 



Task(s) 
Category . 



(or categories) 



Category 



(or categories) 



■ V 



• ■ 'A 



Whioh of the cibot>& etatmewbQ mighi: not invotve miml ooatB fov the 



■'V 



Si 
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MsmRs TO smcxsB i. ; 



1. Task if 



2. Task II, IV 



Category Ote^ 



3. TdSk II 



^ Caltegory Personnel 



4. Task IV 



% 



5. Task I 



Catetgory Data procegsi?ig ^ 
Cat^ory Persoimei 



6* Task I 
7, Ta^ IV 



vategory Persohftet 



Category Personnel 



a; TaskV 



9; Task II, HI 



Category Betyrodiietian (reports) 

Category ^&terial$ acnd T^^prbduGtion. {11) , 
Perymnel (HI) . 



M.' Task 11 



Category Reproduction 



11. Task I 



Category Persorme l 



12. Task II 



Gat^ory l^sonnel, materials i sitppiies 



13. Task I, II> III> IV, V iCategory Personnel 



ft A * 



' Only atdtm^nte Z and 4 involve aotuat <S08t i-teme fop the^eohoot 
diatHot; 1ih& oihea* eUti^mente pefep .to aativitiee wMok may be aoet" 



m 
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•* ^ I*«ntify^aha estimate the costs for 4l cost c;§tegories for es»ch 
ta^ilc of Pupil -Peiyeiveajifeeds.AssesOT^ " 



TOTT 



Co^t Categories 

• piMmAipmpmr 



V- 



Tersonnel 



Bstiinated 
Cost ti;: 



Mttterials mi s upplies' 

■ote — *^ — - 



P orsprme:)^- 



"H^lutwftas and supples 



T ASK H I ^ ^«NtM t Ng :" ^ < ^^^ I hi m C ^ 



^^^^ ^ 




Cfgior . 1; 



4l|pMni ^^.^.L^^^iy ^^1^ y jj^y ^ ^ 



me total estimted cost Should all<?w foi' «mlx«ttf6resei3n .e:<pto$es; ;irt-' 
crmijig the sisn of the 'sub-tbtfils by 101 is n, ciQsiinori inetM used 
adjust an ostiinated budget to t<wer fiiiy tmanticijJiitd! isj^s^^ 



: This unit was liesigned to help you, as Project' Ifemger, develop 
some very basic infonnat ion about your PPMA project, such as time, 
\ cost, an4 personnel .constraints, tJi© pwpose of the p^^ject, the pupi;L 
pbpuiation involved, con^arisons to be dtavin, specifications for your 
PPNA. jjidicator, task s<^edule and time flow, and , information on esti- 
matir^j costs. Aj.1 of tMs infonnation will ^sist you in, coordinating 

^ " • * ' 

the taslcs involved in your project'. ' 
; . The last section; of this unit iJi^jplies both a preparation checklist 
and a completion 'checklist for each of this following units in this 
package (Tasks II to V) to help you ascerttain the cojipiejieness and 
qual.ty of your project \s Project' Manager you will find these check- 
lists very helpful* " ' 



* .1 

ifnU S: [D&veloping.a PPNA IndiaaW v ' 

■^Usted^ belovr are somo selected questions (not a' complete list) 
which will help you to prepare for the development activities outlined 
m Unit 2, 'I ■ 

^ . . It" is suggested that you iriai^e sure that all of this infoimtion 
has been, developed (PI'S you turn to Unit 2, ' ' 

^ 1. According to the schedule you- established, how much time do 
you have for ijthe development of an indicator? 

2. .When Should you start the development task? ; ■ 

_^3. , 'Dofes the task, require a grci^effort?. yes, continue-. If 
«P^r"!&o to item 6 below. ^ 



_ 4* Dp you have a list of the names and telephone numbers of the 
people v*io will be participating in. the development -task? 

_ S, iVhere is the gfoup going to meet? And when? ^. 

Are sufficient si^plies, stationery, and reference materials 
Availr.bie foi j^e indicator development effort? ■ ^ 

7y What did' you decide about having the indicator reproduced? ^ 
Have; you t^ked tp the printer or other individual responsible 
"for the job? 

8. Reminders, and notes regarding above: ' ' 



Vhe.n all of this infomation has 
he&n d0v&top0di go on to Unit 8, 
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: COMPLETIOl^ CimcmST. ' 

.ft 

Unit 2: developing a PPNA Indicator ^ 

. ■ ■ p. . . ' ' " 

The followiiig selected questions provide a checklist to help you 
•assess the development of your PPNA indicator* 

If you find' any task vMch was not perfoxmed, it is suggested 
that it be conipleted before you contiiiue. 

^1. Was the indicator, prepared in- the desired format (i.e., open--' 

ended, rating-scale, or miM)? If there' was a change in the 
format, what was the reasoW for it? ^ 

2. Were ir^tructions developed for the personnel whb are going to 

administer the indicator?' . # 

• 3. Was the indicator completed ^ within the designated time schedule? 
If not, does the time scliedule for the project have to be re- 
adjusts? 

» ...» 

^ 4. Was the indicator revised after pilot testing? ' ' 

. S. Ik)w many coi)ies of the indicator and this instructions for ad- 
ministering it are needed? Are the indicators ready to be ad- 
ministered? 

. 6. Reminders and notes regarding above: 



Wien alt of the above taeks haoe 
been oompletedy continue reading. 
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mmATtON CHECm 
.. •• Unit 3: 'A(MCntBUHng therppm Indiaator ' 

' ' ' . * ■ ' 

o J ^^^^ emtme the iJfeparations that 

are needed to ©nsure success in admimstering . the indicator . 

it is suggested that all o£ these preparations, be made b&fove 
you turn to tfnit 3. *- . v'^ 

— 1- What date has been selected for adraini-stering the indicator? 

TO whiclj classes will it be administered? During which clas's 
periodCsj? • ° 

'■' . ^. • ■ ' ■■• ■ , " ■ ■■ 

— 2, Prepare sufficieait copies o£ the indicator to be administered. 

(Be sure to have e^ctra copies made to cover loss, damage > or a 
low estimate of. the number of pupils involved:) 

3. Distribute indicators by classroom to the participating teach- 
ers before the time designated to administer them* • ' 

^ . . ■ " ' ■ • ■ ■ 

— 4. At the %ame time, distribute copies of the instructions for 

admnlstering the ihdicators to the participating teachers and 
ask them to read them i|rtmediately; be prepared to answer any 
questions, that they may have on administering the indicator' 

_ 5. Remiiiders and notes regarding above: 



K^h&n all of ■bhe8& pr&pamHona have 
hem made, go on to Unit 3, 

/ 



/ 



< ft* 
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The following selected questions ^rwide a checklist to Help you 
assess the steps taken to ensure success in administering ^^t^^^ 

tor, ■■, . : : ■ : -..v--^-" 

U you find any task which \vas not perfotwed, it is sugg^sstei that 
it be toileted before-yoa cMttinuer , ' ^ : ■ . . ' 



1 . Did every teacher receive sufficient cq)ies of the Indicisitor ^ 
' at the designated time? . 

2. Was the indicator administer^ at the designated tajne? 

3. Did you collect all of the con^leted and unused indicators / . 
. from all participating classrooms? 

4; Reminders and notes regl^rding above: ' .' 



Wh&n alt of the above queetiom haoe 
pern andw&x*&d, oontinm reading* 
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- • 'PREPABAnON mmXSiP . ■ • r. . - .^ v' 

Unit 4: Pn'Ooea^'Cng "^^^A :i:ndioatof Data 

The foUowing list mil holp you ejcainiAe* the preparations, that are 
needed to ensure success in processijig the indicator data. 

It is suggested that all of these preparations be inade befox^e you 
tinpfi to Unit 4. ; 

■ ' ■ « ■ 

1 1\ HalJ-e aiTanganents been mde for processing the data? ' 



— 2, Do the^perscainel who .are going to process the data have .the 
following abilities? • , , 

Can they follow written instructions? ♦ 

1. Are they able to work, in a grou^ 

_ Are they logical ^and systematic? 

Are, they able to write readable summary reports fpr the 
appropriate recipients? " ' .. , ' 

H^^ve they agreed to work under the terms specified regarding 

time ^ place, compensation, etc,? , » 

i ^- Have you written a set of instructions on how to process the 

• type of indicators used for the data processing group? ' 

_ S. Will you b^ available to supervise the processing of the data? 

6, Reminder/ and notes, regarding above: , ♦ 



0ien all of th&ee pp&paa>aUone have 
h&en md&i 0o on to Unit 4, 
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The followijdg selected ciwestions iirovide/i h©Xp you 

assess the steps taken to ensure success in pjwessi^^^^^ 



If you find any taslc which v»s wo* perfontied, it is suggested that . 
it m coanpleted before your continue. 

X* Was analysis of the data dcwble-ehecked to avoid any statistical 
• mtox^l ■ . ■ . 

2. Was the task ccarpleted tdthin the designated period of time? 
If not^ do you haVe to readjust the time schedule Ipr the proj - 

3. Have all the papers retlatin^ to data pr6ce$sii:;g been returned 
^ to you, i.e. , all indicators, iriteiinediate coding or tallying 

sheets* and summary report (^j? 

4. taiiiders and notes regarding above t 



when alt of the <xhm>& taeks have heeh 
Qompt&ted, oontinu& reading ^ • 
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• C/nti^ S: Amlyuing and nepovHng PPM Be$u.U$ 

Have decisions beenjtiade about: i 
^ 1. Who should analya©-^e data, and prei>ar© the report? 

^ <^-^assfoom teachers? 

_ ^^il<ii»ig principals? 

^ outside consultants? 

_.<=^©iitr«*l office adndnistrators?- 

.2« ^Vhen the report should b©> submitted to you? 

3. Reminders and notes regarding above: 



When all of these deaisiom have been 
madei QO on to VnU 6, 



6 1 ■ 
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; ^ The fpllowiiig Selected questions prpvi^e gi checklist to helj> you 
assess the isteps taken to ensure success in wlyzing and reporting the 
results.; , . , . ./ , ;• , ■ ■■ * ~ . ■ 

If you find any task iM,c\i was fioi perfomed, it is suggested that 
it be coin^ileted at thi$ time. 

1. Have the data been analyzed? 

1 ' , ■ " ' ■ . ■ ■„...,. 

2. Was a sunioiaTy report prepared? - 

3. Has information been chann0led to the appropriate grpia)(s) of 
people? • ' 

teaches? ' > 

pupils? 

conrnmity? 5> , , , , . 

^central office administrators? - 

4. Have recommendations' based on the report been developed? 
5* Reminders and notes regarding above: ♦ . 



If 



ail of the above- tasks Ime been 
AmeQtirh&nt effopt had hem aottpUted* 
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UNIT 2 

DiSVELWING A PPM INDICATOR 



For use by the Project Manager and 
the group responsible for developing 
a PPNA Indicator, 
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SEQUENCE OF UNITS 



CONSENT OF UNIT 2 



YOU 
ARE 
HERE 



UNIT 1 

PLANNING A 
PPNA PROJECT 



WT 2 

DEVELOPING A 
PPNA INDKJATOR 



1 


f .. • 


UNIT 3 

ADMINISTERING THE ' 
PPNA INDICATOR 






UNIT 4 

PROCESSING PPNA 
INDICATOR DATA 


1 


t 


• UNIT 5 

ANALYZING AND REPORTING 
PPNA RESULTS 

A 

f ! 



/What is a Pupil -Perceived 
N^ds Assessment (PPNA) 
Indicator?.....,.. 2-1 
Validity and Reliability. . . 2-5 
Decisidn on Mode of 

Development.... .2-7 

How to Modify an Existing 

Rdting-Scale Instrument. .2-13 
How to Construct a Rating- 

Scale Indicator ....i..... 2-16 
How to Construct an Open- 
^hded Indicator 2 - 23 
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WHAT IS A PUPIL-PERCBIVED NEEDS ASSES^NT (PPm) INDICATOR? 

DeveXqpiaent groi?) m^ers who have not r4d Unit 1 QOMsjpaclcage 
will need to know, as they approach the tasK j£ indicator developnent, 
what a Pupil -Perceived Needs Assessment (PPNA) indicator is. The PPNA 

4 ■ 

indicator is usually a questionnaire, designed by school personnel to 
obtain data on pupils' feelings, attitudes and opinions on school iji 
general or on a particular curriculum or prograin. The PPNA^iftdicator 
ie not a "test." The term "indicator" was chosen because the responses 
given are supposed to reflto (i.e.;, indicate) what pupils perceive 
as nee^ in the program (dr curriculum) being studied. 

Before your group starts to develop a PPNA indicator, the Project 
Manager should discuss' \dth you all of the prelijninary decisions 
covered' in Unit 1. These planning decisions include information on: 
(1) the purpose o:^, the project (i.e. , why the project is being urider-- 
taken), ^specifying tlie program or curriculum and pupils involved:, and 
any comparisons to^" drawn, and (2) preliminary specifications for 
the PPNA indicator (i.e. , preferred type of indicator, length of in- 
dicator, pupil sa«jpie size, etc.). , ■ 



2-2.. J ' 



I gufifetiormaire. 



A PPNA indicator is usually a gufifstiormaire. kinds of ques- 
tioas used wilt depend on whether the indicator is to be a rating-scale, 
an open-ended or ia mixed questionnaire, 

A rating-scale xiuestionnaire lists statements or questions with ^ . 
a set of "answers provided for each item or question; the respondent 

■ . , ■ . . ■ . . : <^ . , 

indicates his response by circling one of the answers supplied for .each 
U«.o.<,uestioA. : . ■ ■ ■ 

An jopen-ended questionnaire contains questions to which the respon- 
dents supply written answers in whatever form, ; length, or detail they 
wish. 

A mixed questionnaire contains both open-*ended and rating-scale 
items. , . , 

■ ■ , i . " 

^ Sample questions illustrating the three types of questionnaires are 

provided on the following pages. 
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SAMPliMTING-SCALE INDICATOR QUESTIONS * . 

♦ ' 

s Eighth Grade Social Studies 



I think, ^genetaXly, most of the ptojects w© have had in this course 
are: (Circle the appropriate isuniber.) . . 

Not At All Somewhat " ' Very 

a. Time-consuming i ^ 2 3 

b. Difficult ^.j^^"^ 1 2 ^\ 3 

c. Meaningless i 2 . 3' 

d. Ineffective 1*2 3 ' 

I think we should have spent more time discussing: (Please check 
no more than thre^e topics.) 

.: _a* Economics " <' ' __f^ " Media Mlu^ce * 

J). Family Relationships ^ , Jg. Modern Society 



;C. Government and Citizenship h. Poetical Leadership 



fi- Human Behavior ^ . U Religion \ 

^e. Labor Relations j .. WorM History 



6'; 
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SAMPLE OPEN-ENDED INDICATOR QUESTIONS ; 
Eighth drade Social Studies 



this year? ' - 

2. How different from last year is this yearns Socials Studies course? 
'Try to compare the two courses. ' ^ 

3. Given total freedom, what kinds of projects do you prefer, in this 
tourse? V 

4. Which particular topic in Social Studies have you learned most i 
about? \Vhy?, 

S» Do you have any suggestions for improving this course? 

6. What is your overall feeling about this course? (Check one.) 

E xcellent Good Acceptable Fair P oor 

■ // 

SAMPLE MIXED MICATOR QUEST^^^ 
Eighth Grade Social Studies 



I think, generally > most of the projects we have had in> this course 
are: (Circle the appropriate number.) » * 

Nbt At All Stonevtftat Very 

I' 

a. Time-consuming . 1' 2 , 3 



b. Difficult ,1 2 3 



9»s Irrelevant "1 2 3 

d. Ineffective 1 2 -v^ 3 

e. Poorly-ddsigned 1 Z S 

f. Childish ^ " 1 . 



2 3 



g. Dull • 1 . 2 3 

Describe the interactions you have had with other kids' in the course, 
Do you think they have any effect on the Success or failure of the 
projects? . < 
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VALIDITy AND RBLIABILITy 

t 

TVo critical concepts should be considered 'when drveloping an in- 
dicator. They are validity and reliability. ' • 

VaUdity indicates the degree to which an instrument ac-, 
tually measures what it is supposed to measure. Tlie validity ^ 
of a Pupil -Perceived Needs Assessment indicator would depend 
upon the degree to which the indicator can suDply information 
' ' related to the purpose of the project. ' 

RelidbiUty indicates the consistency . of . results obtain^ 
with a given instrument.' If reliable, an instrument can be 
. . used over and over again in unchanging or highly similar 

situations and will produce the same or very similar results. 
In thiSrSf^^;g'i a rating-scale indicator is apt to be more re- ' 
liabjf^) than m ppen-erided indicator. Reli^ability, however, 
, is not as sigjiif icant as validity in the case of an open-ended 
indicator; since it is designed to collect relatively sub jec- 
^ tive information frcan the pupils. 

. Consider, for example ^ a PPNA project recently implemented in a 

California school district. The purpose of the study was to determine 

the" attitudes of elementary pupils toward Social ^Studies. After testing. 

several pupils in the third and fourth grades, the teachers reported 

%t most rDupils did ;iot understand the meaning of the term ♦•social 

studies." Therefore, one would certainly question whether the stucTy 

reall/ could, measure attitudes toward Social Studies! Under the circum-. 

■staiices r(?ported, many of the items included 'in the questionnaire being 

Considered for use in this project had little (low) validity. 



. . 2^6 . 

Can an indicator have i-eliability but la^k validity? Yes. If 
the same questionnaire is administered a second time to the same pupils 
under similar conditions (i.e., no . instruction on Social Studies in the 
interim), it might well yield similar results. The instrument obvioixsly 
measures something, and it may measure it consistently. When an indica- 
tor Is urwelictbtet however, a second study under similar conditions will 
not necessarily yield similar results. 

Another example is provided by^ the experience of two elementary 
teachers in a Texas school who designed a PPNA indicator to determine 
how their pupils felt, about an IPI (Individualized Prescribed Instruction) 
Mathematics program. In the indicator, however, they included iriafiy 
self-concept items that had nothing to do with the IPI Mathonatics pro- 
gram. Thus, many of the questions in the indicator they developed 
lacked validity because they provided very limited infoimation on what 
the teachers really wianted to loiow. 
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DECISION ON MODE OF DEVEIX)PMENt 

As members of the PPNA indicator development group, you can take . 
one of two approaches in developing a PPNA indicator. You can either &el- 
, 0ot an existing px^il survey instrument or oomtmot an. instrument.* 

Since very few open-ended questionnaires have been tested and are 
ready for use, we strongly encourage those who want to use an open- ended 
instnanent to" construct their own indicator. 

If your development gr>au-p decides to take thie approaoh, please 
turn to page 2- 2 3- for instmotions on oonstmating an open-ended indi- 
aator, ^ 

0 

If a rating-scale questionnaire is to be used, refer to the sources 
listed on the next three pages. If you decide to use an existing 

* ' 

...strument, however, it is important that you (1) check the preliminary 
criteria of the instrument very carefully in tenijs, of intent, specific 

♦ 

objectives, target pupil population, language level, validity, reliability, 
availability, etc. and (2) modify the existing ins.trument so that it 
is directly relaSbd^to the purpose of your project. ' 



*When considering these approaches ^ it is suggested that -group 
members consult with the Project Maaiager who, in studying Unit 1 (Plan- 
ning a PPNA Project), has covered infomation on a number of factors 
which might influence this decision. " - - , 
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If you have not decided whether to selzot an esd.ating'mting-adaZe ■ 
instimnent ov to oomtmot your om indicator^ oontime veading. 

Before your group decides whether to select or construct a 
PPNA rating-scale indicator, you may wish to consult the list of pos- 
sible sourpes for existing instruments which fs given below. Sources 
are organized in two sections: Section A includes books or educational 
research institutes where collections of instruments measuring pupil 
attitudes are available; Section B lists ten specific instrments de- : 
signed to collect information on piipil attitudes, needs, and opinions, 
v^-Since nine of these ten instruments caii be obtained from the ERIC 
systeM^^ucational Resources Information Center) , their ERIC code 
numbers are also indicated. The sources indicated are by no means 
exhaustive. Pupil survey instruments from other sources can also be 
used, provided they are suitable for your PPNA project. 

TOglEI^SQURCBS FOR EXISTING INSTRUNefIS TO COLLECT INFORNOTION ON . 

- iji' •■TLiiiJrJ.-.u.i III I I • II *> 

A. BooKs and Educational Research Institutes 

1. Battelle Ivlemorial Institute, Columbus, Ohio. 



2. Beatty, Walcott H., ed. (Inventory prepared by Donald 
J. Dowd and Sarah C. West.) MVPying EducatitMial Assess- 
ment and An Inventory of l^asur^ ^ 
trafidnpoiiTTrirr^^ 

ulum Development, National Education Association, 1969. 



^2 



r 

2-9 



3, ^sen, Pamela, ed. m$ Test Collection . Princeton; ' 
Educational Testing SeriHoG^^ 

4. Instructional Objectives Exchange (lOX) : Attitud e Toward 
School > Kintef ^arten-Grade 12 , Revised EdlHoHTntBs^ — 
Angeles: Instructional Objectives Exchange, 1972. . 

Spec'ific Pupil Needs Instruments , 

^' ggj ^p^p ^^d ,a nd Attitude Questionnaire Items and a Prinri 
diciion Service, ED 072 090,: 1972. v ^^^v ^ *t i^cpro 

^* Public Schools; Student^Survey , 1972^7.'^ . Board 

^ucation ot the €ity School,. i)istrict of the "dity of 
Cincinnati, Ohio 45202, Cbpies of this instrument are 
available upon request* ... 

3. Itobert i , Roberts, Arthur D. The Deve lopment 

' € n ^"f r i ygl^i^^f a ool l ib . ' ' 
aects. BiiC Ibcuipent Reprpfetibn ge rvide, 5D 0 7 ^" ' 3 2gT 

4. Ifenny, James, et al. How Students Sefe Teachers. ERIC 
Document 'Reproduction Service, 077 92i; ' " — 

5. Kunkel, Mchard C* , et al. Questi onnaire It emr- Solicit- 
ffiaSchoolJ^eia^ ^W ldr ml 

. Sip7^;^ran^ 

Service, HD 074 093, 1973, 

6. Miller, Douglas R. Sdiool:Roi,at^^ 
Reproduction Service, ED 076 723, 1973. 

7. Reid, Marilyn J. M Evaluation of City School, 1971-72 
Research Report. SHHsHTOii^-lrr&i^^ 
duction Service, ;ED 074 119,^ 1972. ^ 

Student Questionnaire, ^ 074 120. 

^«S°L?®?ii^®^^ Intermediate Level, Appendix A, 
BD 074 122* 

School Sentiment Index, Secondary Level, Appendix B, 
ED 074 123, ' 
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8, 



10. 



adth, Williaiti F», Comp., et al. Jefferson Parish Schools 
Needs Assessntent Suryey . Appejidix A and Appendix IS. ~^ 
cjcetna, La, : toe Dodnnent Reproduction SeiVice, 
ED 079 367, 1972. 

Karriner, HeioTw. Student Attitudes Toward Foreigrf Language 
St-ud>r -Ite«r at$ of rSirviy: Rich«iQnd7 VL ; MS Document 
l5i5^oa3clC^ Swvice. P 0721^682; 1972, 

Wood, ,Lyna l], A. Study of Student Attitudes Towards Foreign 
Languages irj Public secondary gcRoois of l)t ah, Appendices, 
salt Lake Gity, Utah: MC.fiocwttent ReproStion Service, 
ED 073 711 .1972. 



At 'thiB pointy you may wish) to take eome 
time to looate one or mem of me eom^oee Xiated 
above in order to detertitine wh&th&r or not an 
inBtnonent is av^if able which would be euitable 
for, use ae your PPM indiaator* 



i 



'^4 



mcxsxoH oN vmnm m cqmmcT or mm A mfXiiG'^scAm xmxcArm 



iJeoping your own project in mind, -answer the following questions 
by cfiectog ••yes" or "no" for eich question md ^en-' i^ 
>ju j^el it would i>e prefera^^^ indicator, 
ms pfoiination will enable you to decide whether to s&lect or construct 
your indicator. , • 



.■■ > ■ 

1 . Are there any usable and ef fee- 
tive qiiestionnaires available 
for your project? 

2. Will developing an indica- 
tor require special staff . 
training? Y 

3 . itoes^ your district want to 
use this opportunity to 
develop a school district 
capsibilfty future in- 
dicator construction? . 

4. Do you anticipate «my dif- 
^ficulty in involving, eligi,-- 

ble ffita.ff «i€!nbers? , 

5. t)o you have enough tifite to 
eowstfuc't m ;}ndicat6r? 

6. «b;Di It cost «e to can- 

struct- itijsiis? 





Preferable to: 
Select Ckmstruct 








□ □ 


□ 






□ 




□ □ 




□ 




□ 




L J 







0 




If you haoe deoided to use an ^sHng rating- 
aoale imtmmnti 'bum to the folloiM-ng page foip 
guidelines on modifying auoh an instvment^. 

If you hoi,^ deoided to oonatmbt a vatmg-eaale 
indiaatoT, turn to page 2-16, j 

If you ar*e unabte to decide w^sther to seteat - 
oT aona'truot a vating-aQatedmtnmdnti ooneult both 
the guidelines fo^ modifying an essi&ting inatrument 
which begin on the fottowir^ pa^e and the guidetinee 
fop aonstmating a mting-soate ind^aatoT on ipage 2-'16} 
then make- your decision* 
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HOW TO MODIFY AN "EXISTING 
RATING-SCALE INSTRUMENT 

1 . If you have located an existing, instrument vdiich can be 
modified for your project, be sure to get permission from 
the autlior or the publisher to use it. 

2. It is desirable to start with as much congruence d« pos- 
sible between the . existing instrument under considera- 
tion and the information requirements of your project.'. 

3. Given the statement above, it still may be necessary to 
^^-■r^write items in i'J\e existing instrument to improve con- 
gruence. ' 

4. If necessary, write additional items to ensure that your 
information requirements are met. 

5; Make any necessary -changes in the , items so that the wording 
corresponds to the vocabulary conqaetencies of the pupils 
to whom the indicator will be administered. 

6. As a group, select the items to.b,e included in your PPNA 
indicator. The length of the indicator will depend on 
how much time you allow the pupils to answer it. Also, 
decide., in what order the questions should be arranged. 

7. Edit all iteiiis to- eliminate ambiguities and increase 
expiicitness; any compound items should be deleted. 

8. Allow space at the end of thC' indicator or at th§ end of 
particular sections where the pupils can provide addi- 
tional coiranents. These are frequently enlightening in 
their own rights and may supply important 'infonnati(9in for 
use in subsequent revisions of the indicator. This is 

' especially important when the indicator is being pilot 
tested. 
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9, Insure the anonyinity of pi^il responses. 

10. Develop an answer sheet for the pupils, if necessary. 

11. If necessary, revrite the instructions for the people who 
are going to administer the indicator and for the pupils 

to whom it will be administered, keeping in mind their age, 
language level, and ability to express thonselves. the 
instructions for those administering the indicator 
should include infoimtion on how to administer the indi- 
cator, how long it will talce the piJ5)ils to complete it, 
* .vfliat they are supposed to do before, while, and after 
administering the indicator, etc. 

12. If you intend to liave the data processed by computer, ask 
one of the computer staff to help you set im the answer 
sheet format to faciliate key punching. 

13. Pilot test the modified instrument to verify that the it^ 
are adequate, unambiguous, and arpropriately worded and 
that the ^instructions are clear. To pilot test the indica- 
tor. It IS administered to a sm^l group of pupils who, 
vtfiile not members of the ssaapU group, are similar in 

age and ability. After the intlcator is administered to 
these pupils, they can be interviewed individually to 
uncover defects in the instrumerc or they can be requested 
to supply written comments conc^^mlng the indicator ."^ 

14. Revise the indicator in accordanc^-^Mth the findings of 
the pilot test. If extensive i:eVisions are required, it 
may be a good idea to pilot ,t¥st the revised version. 
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\ WORKSmf 1 



FoUowiftg the gwidelines v>M(?h .begto page ^-l^: 

1> ^iodifjr an existing.rating-scale inst™ent lor yow 

project, : , . : : 

2. Develop an answet sheet for the pi^'ils, i£ necessary, 

3 , Prepare instructions for the pupils to whom the indicator 
will be administered. 

4, Prepare instructions for the people who ar6 going to ad- 
minister the indicator. 

>■ , ■ ■ • ^ ■ • ' ■ : ■ ■ 

5. Pilot test and revise the indicator aiid the instructions. 



Tt4m to page S^SS 
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HOW TO OONSTRUCT A RATING-SQVLE INDICATOR 

On a rating-scale questionnaire, pupils usually are asked to give 
their opinions or perceptions in response to specific statements or 
questions by selecting from a series of possible answers the answer 
jthat most closely expresses how they feel. The number of possible 
•replies supplied may run from a dichotomy to a five-point or even sevon 
point scale, depending; on v^at the developers of the questionnaire con- 
.sider'both appropriate and sufficiently explicit. 

The sample questions provided below serve two purposes: (1) they 
show you how varied the questions asked on a PPNA indicator can be and 
f2) they provide an inventoiy of response, choices that may be heli^ful 
in constructing a rating-scale indicator for your PPNA project. 
I.. Dichotomous Responses ' , 

Agree -True 
Disagree False 




V 

Yes 1^ 

1. Do yoii enjoy field trips? ' . □ □ 

2. Do you need more help from your teachers? □ □ 

3. Do you worry abcxjt/^ur) school work? □ □ 
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1. Teadhers care about me, 

2. i get praise at home for * good schoolwork^> 

(The above examples are from the Cincinnati 
Public Schools, Student Survey, 1972-73.) 



/^ree Disagree 

□ □ 

□ □" 



Three -Point Scale Responses 

Yes .. Agree ' 

No ' Disagree 

Don't Know a Don't Know 

Sanple Questions 



More' 



« Less 



The Same 



1. Do you do more or less reading 
than is required by your school - 
work? 

2. Do Vou think you participate in 
extracurricular activities more 
or less than the other studfents 
in your class? 

3. Would you like to have more or less 
help from your teacher? 

4. Would you like to have more or 
less contact with your teacher? 



?4ore Less " The Same 



□ □ 



□ □ 



□ 
□ 



□ 
□ 



□ 
□ 

□ 

□ 

I^IUll 



J 



2-18 



, i<A. 



Four-Pblnt Scale Responses^ X 

Strongly Agree Fre(quently Ver/ Important 

im^s Import? 



Unijnpora:aiit \i Easy 

iamportan/\ Very Easy 



agree or 
sheet 



Agree , . s 

Disagree - Rarel 
Strongly Disagree Ne^er 

Sample Cjuestions 

For each statement, indirate the extent to whicli,.«u a 
agree by circling the appropriate. letter on the inswer 

s (A) if you strongly agree 

(B) if you agree ^ ^ 

(C) if you disagree 
CD) if ycu strongiy disagree 

This school .is run like a prison. 

If I did something wrong at school, I 
know I would get a. second chance. 



feyy Difficult 
Di^icult 



1. 
2. 



Students have enough voice in deter- 
mining 'how this school is run. 



4, 
5. 



I like to talk to my teachers after 
class. 

School is a good place for making 
friends . 



A B 

A B 

A 1) 

A R 

A B 



C 
C 

C 

c 



D 
D 

D.' 

D 

D 



(The above examples are from School Sentime nt Index: Secoi / 
I' ^vqU Ihstructional Objectives fixclSSSenWCu'lox 
L(^^geles, California 90024.)' ' 
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IV* \ P|.ve-Po int Scale Respoaseh 

, A Great Deal Excellent 

Mdlfe Than Average Good 

So^ Acceptable 

, tofes Than Average Fair , 

, Norte Poor 
Sa iitole Questions 
To What, extent do you think 



Very Important 
Jn^ortant 
Fairly Important 
Fairly Unimportant. 
Unimportant 



Always 

Often 

Sometimes 

Rarely 

Never 



A Gr0at 
Deal 



student. ideas can influence: 

More Thari Less Than 

Average Some 



None 



d , what goes on 
in class 

, b. field trips 

c. free time 

d. career projects 

e. language arts 
projects 

f. hcwii^work 

g. c:).ass groitping 

h. fumiti re- 
arrangement 

, i. behavior courses 

j* elective courses" 
available 

(The' above example is :^rom the High School PPNA Indicator, TJie 
Foundation School, Orajige, Coim«xticut» 1973.) s 



lJ 


□ 


□ 


□ 


□ 




□ 




□ 


□ 


□ 


n 


□ 


□ 


□ 


□ 




□ 


□ 


□ 


□ 


U 


□ 


□ 


□ 


□ l 


n 


□ ■ 




□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


' □ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


' □ 


□ 


□ 


□ 
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GUIDKLINES FOR CX)NSTRUC11NG A RATING-SCALE KNDICATO 

1. Refine the purpose of the project, if necessaiy. ^ke 
sure that the purpose is Clearly understood by all 
members of the development group. 

2. List a few topics! related to the purpose of the proj- 
ect. These topics should be dimensions or factors re- 
lated to the information you are seeking and should en- 
able you to formulate questions In such a way that pupil 
responses will st?)ply the information you need. This 
can be done in. a groi^) brainstorming session. 

3. Determine which of t^e topics listed would be most meaning- 
ful to the pupils involved. Consider, for example, vdiether 
the pupils have been exposed to a program long enough to 
have perceptions about it which they can communicate. 

4. Develop rating-scale itons. (This is the most critical 
task in the development process.) 

a. Each grot^ member develops one item for each of the 
topics selected and is able to explain in detail why 

^hev feels those questions should be included. 

b. As a group, all members (review the items developed 
and carefully select the items most closely related 
'to the purpose of the project. Item: selection should 
be acconplished through candid discussions in \ihich 
ideas are shared. 

c. Refine each item se:j.ected through*group discussion. 

5. As a group, decide, in vkkt order the items should be 
arranged. The length of the indicator will depend on 
the tiwe you allow the pupils to answer it. 

6. Edit ^ all items to olimlnate ambiguities- and increase 
explicitness ; any compound items should be deleted. 
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7. 'Allow space at tho end of the indicator or at the end of 

particular sections where the pwpils can provide addition- 
al comdnts, Tliese are frequently enlightening ixi their 
own right and may supply important information for use in 
subsequent revisions of, the indic^itor. This is especial- 
ly important when the indicator is being pilot tested. 

8. Insure tlie anonymity of pupil responses, 

9. Develop an answer sheet for the pxipils, if necessary. 

10. IVrite instructions for the pupils to whom the indicator 
^vill be administered, keeping in mind their age, language 
level, and ability to express themselves. 

l;i. Write instructions for the people who are going to ad- 
minister the indicator » The instructions should include 
information on how to adirtinist^r the indicator, how long 
^ it will take the pupils to complete it, what they are. 
supposed to do before, while, and after administering 
the indicator, etc, 

12. If yon intend to have the data processed by con5)uter, ask 
one of the computer staff to help you set up the answer 
sheet format to facilitate key ptmching. 

13. Pilot test the indiicator to verify that the item^ are 
(adequate, unambigucius, and appropriately worded and that 
the instructions are clear. To pilot test the indicator, 
it is administered to a small g(r6up of pupils who, while 
not members of the sample grou^l, are 'Similar in age and 
ability. After the indicator is administered to these 
pupils, they can be interviewed individually to uncover 
defects in the indicator or they can be requested to 
supply written comments concerning the indicator. 

14 . Revise the indicator in accordance with the findings of 
tfie pilot test. If extensive revisions are required, it 
may be a good idea to pilot tost the revised,version. 
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Fcaiowiiig the guidelines which bdgin oil page 2-20: 
' 1 , Const nict a rat in ^-scale indicator, 
' 2» Develop an msmr sheet for the pupils^, if nec&mry. 

Prepare instructions f6r the pupils to i^hom'the iijdicato; vdll 
* be adniinistered. 

Se^SiStor^^*^*^"^ ^^^^^ ^^^"^ administer 

5, Pilot test and- revise the indicator aid the instructions. 



■A 



Jlhitm to page B^-SS, 

t 
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' HOW. TO OONSTRUCr AN OPm-BNDEi) INDICATO 



Tlie most distinguishing characteristic of open-ended questions is 
that th^jy do not provide or suggest any ^structure for the respondent's 
reply. Therefore; pupils are given complete freedom to respond in their 
own terms using their own frame c.f reference. Such responses pxovide 
valuable, first-hand information which, in turn, ^ives teachers and ad- 
mlnistrators a more accurate idea" of piqails' perceptions of whatever is 
being investiga|:ed. . 

Jhe following guidelines should be helpful if y^^u are going- to con- 
struct W open-ended indicator i 

1. Refine th^urpose of the .project, if necessary. 

The pm,oose of t>ie project was defined in lAiit 1. This 
definition, should s^ify ivhy^the project is "being under- 
taken and should include information on curriculum or 
j : ' program and pupils involved and any con9)arisons to |be 

I drawn. The pVoject purpose should be clearly understood 

' by all membeis of the development g-roup. ^ , ^ 

Now^ turn tQ )x;ige and aompUU Vox^keh&et 3. 

2 1 List a few topics related to the purpose of the project. ' 

These topicsi should be diMensions or factors related to 
the infoimation you are seeking and should enable you to 
formulate questions in such a. way that pupil responses 
- will supply tlie infonnatian you need., This can be done 
in a group.^brainstorming session. 

/ ■ ■ ■ 
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ScafftB ample tppiss related to pupils' perceptions of a 
Social Studies program would. be: (1) learning environ- 
ment in Social Studies, (2) materials us.ed Ijti Social 
Studies, (3) )K»neworIc/ and (4) Social Studies -related ) 
activities/ ^ / 



A'<?Wi turn t'O page and Qompl0t& Worksheet. 4* 




4. 



lop several open-ended "questions for each, of tlje topics 
LCted and eacplain in detail why you feeJ. those ques- 
tions should be include^. . 

There are three ways in whidi open-ended questions can 
be structiu^ed: 

a. Questions can be uslced in an objective way. "This" 
kind of question tends to eliqit a broa4eit* range of 
ptipil responses. ' 

Sample Qumtion: "What ia'a sohocl for^V^ 

b. Questions can be asked in a subjective way. Here, the 
ciuestion is designed to elicit a very personal response 
from the pt|)il. ^ 

Sanrpte buen-uiloni "P/hy do ypu aatne to eahooU" 

\ c, Questiohs can be incon^letely phrased, so that the 
pupil can coiDplete them in his own i«3rds.. > 

Sample Question: '*X oome to eohool to 

For each topic celected, decide Whether several questions 
or a single question should be developed. 



5. Make sure the questions are appropriately worded, keeping 
in mind the pupa^ls* ages, language level, and ability to 
express themselves. 



a. The wording /should, provide =p',4pils with coilplete 
fi'eedom in their responses. 
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b. Tlie questions should be presented in a neutral way, . 
^ so that neither positive nor negative angers axe 
encouraged, 

c» Avoid the use of "questions v*iidi' can be easily answered 
by 'nfes," "No," or ♦•Don^t Khow." 

d. To lessen the liJceiihood that answers will be uninfor- 
native, instruct the pupils to write at least one 
paragraph on v'ach question. For students^ in the 
higher gradeis, more elaborate answers can be requested 

. to meet your infonnation requirements. 

e. oMaJte the questions as siB?)iy, «::lear, and brief as 

sible. Avoid compound questions. 

, « ' ■ * 

f . ,JJie questions sliould be directly related to the grade 
. o^^tratwd^J^/el of the pui|ils involwd. ' 

g. m swe that any .teiETOs used in the questions are 
familiar to the pupils and cbni,rst©nt with vfliat is . , 
being taught in class. . . 

h. Make si!re that every cpeklon ha.* a lUJfiber and that 
the questions are numbered consecutively. Itambered 
quesVAons cqmplicate rostering and data analysis pit>- 
cedtires. - ' - , . i . ■ , ' 

.1 

The sample open-ended, qyestions below were developed to 
cover several topics selected for use in a project de- 
signed to collect infonriation osn a Social Studies cur- 
riculum: * 

Topic 1. learning environr«eht in Social Studies. 

S0n^U Que&Uoni '^eompax^^d to la&t ym'*^ • 

<iom'60^ this y&m>*6 Booiat 
B-tudie'i p»ogi>mt is,,,," 

^ • ■ " 7 
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Topic 2, Materials used in Social Studies. 

S0npl& QueaHon: '"To me, the lesebns in our 

' Soeiat Studies tessthooka are 

' . . . n ' ■ ■ ■■ 



\ 



Topic 3. ' Hcjiiieworlc. 

« 

' Sontple Question: "Our Sooial Studies 'home-' ■ 

' Vfork t8. . . , " * 

Topic 4» Social Studies -related activities. 

Sample Question: "Hod do you feel about'. 

activities like role-'s^ 
playing government offt^bm>8 
• ■ in your Social Studies 

: . ' " QoxJirss?" ' 

Noida turn to page B'-Sl and aom^tete Worksheet 6, 

At the end of the indicator > always provide space for tl;e 
pupils to express their overaS I feeling about whatever . 
your project concerns. For instance, ask: Vlhat is your 
overall feeling about Social Studies? _ (Check one.)^, - 

' Excellent Good ^Acceptable . 

' ' ' t ' 

jPajtr _ ■ Poor ' 'S ' 

This infomation vdll be very helfiful when the open-ended 
respbnses are bsing processed. (See Unit 4 for more de- 
tail on proces, - the collected data.) 

a. Considerations related to indicator presentation: 

(i) Insure the anonymity of pupil) responses'. 



(2) Write instructions for the fUpils to whom the 
Indicator will 'be administered ^ keeping in 
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mind their age, language level, and ability to 
express themselves. 

(3) Provide^adequate space/ for answering each opent 
ended question, 

. (4) Allow space;at t^ie-eild of the indicator or at 
the end of partAcular sections v^iere pupils 
, .:an provide additional conmejits. These are 
frequently enlightening in their own right and 
my svBpply .i#ortant information for use in 
subsequent revisions of the indicator. This 
is especially\iji5)ortant vdien the indicator is 
being pilot t 

b. Considerations related to Wertesks : 

(1) Write instructions for the people who are going 
to administer the indicator. Th^ ijistructions ^ 
should include informtion on hovP to administeV 
the ind?xator, how long it will take the pupils 
to coniiiete itv what they are si^posed to do be- 
fore, t^dle, and after administering the indica- 
tor, etc, > . 

(2) Refine the key response Categories you have 
listed by re-examining them. 

8. Pilot testing 

Pilot test the indicat'^r td verify that the it©iis"^are' 
adequate, unambiguous, and appropriately 'worded mid that 
the instructions are clear.* To pilot test the indicator, 
It is administered to a small grot?) of pupils who, v^ile 
not members of the samplo group, are similar in age snd 
ability. After th" n. .tor is adjninistered to these 
pupils, they c. ben. ; dewed individually to- yncover 
defeicts in the indicati . or thcsy can be requested to 
supply writ ten. comments concesaing ^e indicator. 
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Miexi pilot testing the indicator, you Will also find out 
approxinwitely how jnucli time the pupils need to conf?)lete 
it> and how many questions caii be includ<jd.> Be certain 
to allow enough time for all of the pupils to »;on5)lete 
the, indicator. The more conscientious pupils may take 
longer than others, and data from them are obviously 
valuable. ' 

R0vise the indicator in accordance with the findings of 
the pilot test. If eactensive revisions are required, it 
may be a good idea to pilot test the revised version. 

.NoDj turn to page 2-^32 and oomptefe Worksheet 6, 





I 
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Keeping^ the guidelinpr in wWy^ M^lowing Activities: 

1, As a gtoifl^), disoWs the purpose^of the project M 

2. Recdifd hete coniplete ittfomtion xm the purpose 6£ ydur project, 
as refined during group discussions. Include infotmation on 
the curraculura or program, the pupils involved; and the compari- 
sons to be drawn. ' 




/, 



twm to guid&Une 2 on page S-^sh 
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wmsm 4 , 



Keeping th^ gi^Min^s in mind, la^dnake the^ to activities t 

' ■ ■,• ) • ' ' ' ' . ' • ■ 

1, As an indpidual, list a f«w tp^Jics that you personally think 
are most jcXosely related to the pupose 6£ the project* 

2^^_Disp*s^;^th otlier^^: the topics they have listed. 

3, As a group7 select-i^^^ 

pose o£ the project. — ~ , 




Afi&p aompt&bing this mvkshe&'ba re* 
iimi to guideline B on pctg&^ 2-24* 
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2. 



Keeping the guidelines in tnind, tmdertake the fdlUoWiiig activities: 

I. Aft art individasl, each group n»e#er shmi^ least <i>«0 

open-«rided qufestion fbt eadi topic"#IBtedr Bach <iyestion should 
, be aCco^ an explanatiort of Wtt^M telate^ to the topic. 

Collect all the questions deVeldped by group meniberS and as a 
group discuss Milclv on^s ^re most iijolevant to the topics selec- 
ted. One class p^^iod is" usi^aily allowed t ^ administering the 
indicator, teping^^^t^^ how masi^r questions 

can be included xnj your indicator . 

For eacJi question ^elect^n^liS^^^^ pifflE>il responses by 

Itey categoi^. •Ihis will saW time lat^ when the data are bein^ 
processed. (This di,scu^sed in nwre detail iiv IMit 4 in the 



3. 
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\ . Aft&v ohmpleting thie wopM&^t-,^^'^ 

\ - ' -bum to guickMne 6^ on page S-S'^rj , 
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Keeping tho i;uidelines in in^ undertake,, the fpllowing activities; 

1* Aarrange the questions selected in a clean, dfear form. Be 
sure to include a.questiori at th^ end of the indicator regard- 
\ ing ^he pupil's overaai feeling (e.g» , about Social Studies 
or whatever is being studied in your project).' I^rovide a 
..five-point scalie for responses l^cellent, Good » Acceptable, 
Fair, Poor),,- . .. ■ ' / 

2. Prepare instructions for the pupils to whom the indicator */ill 
be administered.^ • ^ 

3. Prepare instructions if:or the people who are going to administer 
the indicator. i • • ' 

' ^ • ■ ■ < . \ "■ . ■ ■ ■. : 

4. Keep a record by key category of probable pupil responses to 

4ach question for use in processing indicator data (lJbit 4)V 

5. Pilot test and revise! the indicator and. the instructicns. 



omp.Ui& 0i$<Mm% ^kkoHi^-t* o 
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FIML CHECKLIST > 

Completing this checklis.t vrill enable you to make sure that all 
developmental activities have been undertalcen. • 

A. For mixed indicators: ^ ' ' 

— 1. Haye^you combined rating-scale itcaiis and open-ended 
Items for pilot testing? 

B. For all indicators t 

* ^2. Have you pilot tested the\indicator? . . • 

— 3., Have. you gathered written or oral comments from the * 
pilot test pupils? 

— 4.. Have you propAred answer sheets for the pupils, if 
necessary? ' v v ^ t 

XiS. Have ybu prepared instructions for the pupils as well 
as^for tne people who are going to adminis^ejuthe 
> 

_;.6. Haye you revised the indicator and the instructions a£- 

— . ^&i^pixot .tqkt_ing?_ _„ 



The QbmglMon.of the taeh outlined 
ab'aoe max^ks the end of yom* develop- 
mental effort. Now, return the^re- 
vised indiaator to the Pn^ojeat 
Manager?,, . , . . 
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For use by the people responsible 
for administering the Pupli-Percelved 
Needs Asaessment l^xidicatot*. 
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SEQUENCE OF UNITS' 



CONTENl' OF UNIT 3 



YOU . 
ARE 

HERE^ 



UNIT 1 

PLANNING A 
PPNA PROJECT 



UNIT Z • 

DEVELOPING A 
PPNA INDICATOR 



UNIT 4 

PROCESSING PPNA 
INDICATOR DATA 




UNIT 5 

ANALYZING AND REPORTING' 
PPNA RESULTS 



UNIT 3 

AEMINISTERING THE 
PPNA INDICATOR 




Purpose of TFiis Unit 3-1 

What is Pupil -Perceived ' 

Needs' Assessment?. . . r. ^. . . . 3-1 
How to Administer the Indi- 


^^^^ 





' PURPOSE OP MS UNIT .. ' ^- 

The purpose of this twit Xs to kr0v3.de the people who are goipg 
,to administer the Pupil -Perceived Jfcleds Assessment indicator ^th guide- 
lines designed to help them accompUsh this task both efficiently and" 
^ according to the instructions supplied by the development group. 

To administer the indicator ptoperly,^you' will 1 need infoWibn^on 
the purpbse of this Pupil -Perceived Needs Assessnipnty eject, your role 
m the- project, and the indicatorltself . You-wiU ne^^ to familiarize 
yourself with the. procedures for; administering the indicator and with 
the content of ^e indicator, m^ase the pt^ils have queskons about 
aiiy of .the items included. ' - 

WHAT IS PUPIL-PERCEiW NEEDS ASSESSMENT? ; 



~-J^-~<>«ieJ^~tojEuraish^^^ 

, Perceived Needs Assessment we wiU discuss the subject briefly, in 
terms of the toptc^. outlined below: / 

1. I>urFose of Pupil -Perceived Needs ^Assessment. * 

2. ^ Possible uses of Pupil-Peicei^ved -Needs Assessment data. 

3. The Pupil -Perceived Noeds Assessment (PPNA) 'indicator. 



' •• ;\ 
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: Thai purpose of Ptflpil -Perceived Needs Assessment is to collect ih- 
formation on ipvpil attitudes, reactions, and feelings toward existing 
or new programs (both curricular and extracurricular) or toward edu- v 
cation in general, and to assess pupil neqds from the pupils' perspec- 
tive. Information" on pupil -perceived needs , together with'other data 
collected from ..teachers, parents, citizens, state policy-makers, etc. j 
will prove useful to school* district personnel in making decisions re- 
lated to planning,, making changes v identifying problems, implementing 
new programs, or strengthening effective.. programs. 
>-HQSsible usee of the data could be; 

1. To make the olaeeroom teaohex' sensitive to the i)er- 
, ceived needs of the pupils in his/her classroom. 

A 

2. ^ Td inform the aahoot pvinuipal about problems which can 

be corrected at the budding level. 

3. To ehcourage the distriat planning staff to address 

. expressed needs through iii4>roved planning for curriculum 
^r-other-programs, — ' ■ ■ — — _____ 



Youx* vote is to administer the PPNA indicator. What does that 
mean? • It means that you are responsible for giving the PPNA. indicator 
to pupils (this task is discussed on the following page in more detail) , 
so that information from pupils can be collected and processed. 



. Hi - 



f The PPM indiaatox* you are going to administer was developed by ^ 
'developrtient group^made up of school personnel familiar with the^urric- 
ulum area being assessed. Usually, the indicatdr is in a fonrwlp.ch 
requires written responses. Instructions for the pupils Ire provided 

> 

on the indi ator, although they may have to be explained °|:o pupils in . 
" the lower grades. With pupils who do not have the verbal ability to 
give written answers, the indicator' will. have to be administered orally'. 

HOIV TO ADMINISTER THE INDICATOR 

Suggested procedures for^administering the ind^ator are outlined 
below: » 

✓ 

• Before Administering the Indicator ; - ' 



1. After receiving your package of indicators, make sure' ' 
that you have aii indicator for each pupil in your class 
plus a few extra copies. 

2. It is important that you familiarize yourself with the ' 
indicator. By reading it* through j you will be able to 
anticipate some of the kinds of questions that- the pupils 
might ask. . ^ - f f 

While Administerin^a; the Indicator : " ' 

1. Be sure to make some introductory comments which\cover 
the following pol Its: ... 



IflO 



J 
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a. If pupils ^ names arei not to^be given (to enable them 
to answer freely), this shoiiLd be mentioned. 

b. Pupils should read the instructions -parefiaiy before 
- answering.- 

c. /fell the pi^ils that you are willing to explain any 
dnstructions or any indicator items which they 'do 
not undferstai^d. • , • 

* d. Mvise the pupils that they will not be graded 'on 
the indicator but that it is important for them to 
answer the questions honestly an1i fully. 

e. . Explain to the pupils that their comments and respon- 
' ses will provide important information which the 
school .syst^ can use. in making decisions and plan- 
ning in^rovements. , / . 

f^ Urge the pupils to answer every item in the indica- 
tor. 

■"* * . \ 

■ g. If the question^ are open-ended, request detailed 
answers (at least one paragraph for each answer)/ 

♦ 

h. Encourage the pupil's to add any written suggest ipns. 
or comments tney want to^make on the i^^dicatoi . 

2. Administer the indicator as scheduled,- making sure that 

— •-«ai:;h--pt^i4-lias-a-penfei4--0r-pen-. — * — ■ — 



3. Do not -monitor the pupils in suc^ a way that you can tell 
how they are answering the questions; 



After Administering the Indicator : ' , ^ 

1. Collect all of the indicators and place them in ain 
envelope on whicJh your name and class are indicated, 

2. Re.tum the completed indicators to the Project Manager. 



\ 
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For use by the people responsible 
for processing PPNA Indicator 
data. 
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SEQUENCfi OF UNITS 



YOU 



7~mB 

HERE 



^ UNIT 1 

PLANNING A 
■ PPNA PROJECT 

■V- 



I 



UNl'T-2 

DB/ELOPIN^ A 
PPNA INDICATOR 



UMIT 3 

ADMINISTERING '-'THE 
PPNA INDICATOR 



. UNIT 4 

•PROCESSING PPNA" 
INDICATOR DATA 



UNIT .5 . ; • 

ANALYZING AND REPORTING 
PPNA RESULTS 



CONWr OF UNIT 4 



Coding the Indicator.s . . . . 


4-1 

« 






4^1 


A 


Processing Open-ended 
Indicator Data .". . . 


4-2 




Processing Rating-scale 
Inciicajor Data. ......... 


4-16 


---- 


Summari'zijig the Data...... 


4-21 
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' ' » . CODING THE MICATORS . 

.4fter the indicators have been collected, all of them should.be 
* '• ' „ . . '''■.( 

given. code numbers which could be indicated in the upper right-hand 

■*>.'■ , 
comer of each indicator. Consecutive numbers should be assigned to 

the indicators from^^ach class. 



SAMPLING 



After the indicators have been coded, the group responsible" for 
processing the, data should decide whether all the indicators administered 
are tb be processed or only a certain, percentage of them. It all of the' 
indicators are not goiaig to be processed, the Project Manager should, 
make sure , that a proper sanple.is .drawn for probeising.' Instructions on ' 
drawing a sample can>e found in Section II of the Supplement --Sampling, 
if you nfeed assistance in drawing a representative sample.. ^\ 



After the two tasks mentioned above have been completed,' you should 
be ready to process the indicator data. ' / 



Fov instmationS on prooeestng open- 
ended indicator data, continue reading, 

* 

For instructions on processing rating- 
scale indicator data, turn to page 
4-16, 
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PROCESSING,, OPEN^^ED INDICATOR MTA 

The procedures for processing data from open-.ended, indicators 

are more involved than those for processing rating-scale indicator 

data, becaxjse^the free responses given by- the pupils must be con- 

verted into meaningful categories, for analysis before they can be 

tabulated and sunmiarized. Tli^^fol lowing list covers the four tasks 

involved. Each w^l be farther explained as you continue reading. "* 

I. Recording Overall Pupil Attitudes 

This prbcedure simply involves recording the pupils* over- 
' all attitudes toward the program under assessment az in- 
dicated on the indicators by the pupils themselves, 

\ ■ * • ' o 

ir. Categorization • / 

"nils' procedure involves determining the topics or categor- 
ies into whicl) pupil responses will be grouped for furthei 
■ analysis. * 

IIL Tabulation * • ' . 

_ ( , In perfonning this task, pupil responses are tallied and 

entered in the appropriate categories determined above. 

IV, Summarization . , ' 

The tallies are totaled for. relevant groups, the apt)ropri- 
ate figures are calculated, fjid a summary statement out- 
lining the significant ckaractdristics of the data is 
written. 



IO7 



RECORDING OVERALL VWll ATTITUDES \ •. 

In Unit 2 (Developing -a PPNA Indipator), it was suggested that each 
pupil be asked to indicate his ovekll attitude toward the program be- '-^^ 
ing assessed with an open-ended indicator, i'.e.^ what is your overall feel- 
ing about this course (or whatever is being assessed in this project)? " 
(Checlc one.) . ^ , / 

* Excellent Good Acceptable ^Fair Poor 

When recording these overall ratings^ symbols lil-- ++,+,' o, 
can be used to represent the five response^ given above: ••++" can be^ 
used for "Excellent,"' "+•' fbr "Good," "0" for "Acceptable," "-" for "Fair," 
and' "--" tor "Poor." / . * . • 

,^A sanple fom for recording overalX^pil attitudes is provided on 
the following page. 



/ 



V 



r. 



4.4 



0 



Sarfiplle: llie .form below shows how overall pupil attitudes might be 
^ \ recorded i ^ 



Class: A 



Number ^of Indicators 



Saii^led : 



Indicator 



- Ovei^ll Attitude 



■\ 



Code Nun:ber 

" " J 1. 




'4- 


0 






■ ^ 03 






/ 






-.• ♦ 
08 ' 




■** 




















12 












% 13 












17', 






s 

i 






16 








t 




21 


0 


> 








27. v' 


7 








0 



1* ^, 



1 
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WOUKSHEET FtECOEDXNd OVmALL WPIh ATTITVDES 



On this sheet, record overall >upil attitudes using the symbols ++, 
+» 0, — fpr fixceilent, Good, Acceptable, Fairy arid Poor respective- 
ly. Record this infonnatiori for eaoh cXass. Insert blank sheets of 
paper here, if more pages are needed, _ , ; , , 



Class: , Number of Indicators " 

Sampled.: ^ ^ 


Indicator 
Code, Number 


Overall Attitude 


++ 




0 






! 


y 


• ** «M «» «b ^ «. 








• » h* m m m. ^ 

* M M M M W« M 


0 

«■ M #k M M «» 

• 'ft 


m^m 4M M •» M w M 


1 

K 


■ \ 








>» «* M w» M Ml M 


« «iv'<^ ii,^ to M 


■ 4V «» M M «■ 


\ 

Hmm M .^^MMW 






»' 




\ 










>• 


/ 




1 

1 r ■ • ^ 








1 
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aTEGORIZING PUPXL RESPON SES^ ^ 
Purpose / 

• To determine which key. (yfat^gories ^re mentioned most frequently in^ 
pupil responses. , . . ^ ^ 



^ h-ocedures . , , ^ 

; — ■ # . ^ ,.. . ^ . 

A. Haviijg read each indicator sampled, each gx*oup member^ suhnits 
a list of frequently appeai^ing comments to the ^oup leader. 

-B. The lists are combined, then the comments most frequently made 
are abstracted. , " ^ . ' . 

■ X ^' . ■ ■ . ^ >, ' ' ^ - ■ 

C. The ?:omments should be separated:>into categories ^ The ' most 
.. frequently mentioned comments may form as many separate' cate- 
gories. \ 

Some .Guidelines for Categorization - ^, ' 

1. The categories established should not be restricted to 
those used in the examples given here* * 

' '> ' - • •' ■ . ' ' ■ . ' ■ ■ 

^ 2. .Th6 categories used <^o npt have to be equally tin 

extent; one. frequently I mentioned comment may fo a in- 
dependent category or s^eral .related-- comments may form a 
single category. - , 

3, The' number of categories may. vary from 5 to 20, depending 
on the quantity and coii|>lexity of the pupil respc ^ -^^ 
, ' ' involved. ^ ■ \ 

' i ■ 

Examples of both key categoriesj (designated by roman numerals) and 
pupil cormiients related to those categories are supplied ori the following 
pages . - . , „v- ^, 
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Sample "Key" Categories ajid Related aliments 

I. Classroom Work , . 

1. "I like to work on projects with dthej's"^ . .V "Working 
': .. ■ toge'ther was a lot of £un" . . . "We| gave eadr^ther 

ideas , and learned i}iore" 

2. "I liked to work alone" . . . ''Comi up m/.cm ideas" 
, " ^A. .yi!Do^ings-on-iny--xj^^ 

5. ."Liked class discussion'' ... '*Learr)i and understand 
more" . . . ♦♦Speak ^our liiind" . , . ♦'Liked to tell others 
£^out my. work" ' . * ' 

•/ ' ■ . l~ <,. ^ 

II. Grades and„Tests , . - 

' 1. ♦^iked the idea o£ no grades and tests^'^ "Didn't 

have to worry" ... ♦'Work e.asier without pressure" - 

;■ • \\ .. - \ ■ • , 

• Ili. Workload : ^ ^" ' 

li" "I had to do hard work but I liked it" "We are [ 
doifig twice as much as last year and I like it thi'si " - 
way'* , , , • , . 

2. "We were 'promised study halls'^ . . . "I nefed a study 

period during "the' school day" . V, ^ 

\ ^ ■ 3* "The work is too demanding" "The pres,sure is too great' 
... "They. rush us too much" 

4. "li has been fun .and eas){" ... "It's not hard to do the 
. • work and some of - it is a lot" of fun^^ 

5. "The work was too easy" "We didn't 'do any work arid it ♦£ 
no fun at all" • ' 

•■ ■ _ ' ., , 

6/ "There was too much' work" ... "In thp booklets, th^re were 
too many questions and too much work" ... "We had too many 
repdtts to do" ' 



ll2 
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• 7. *Too muchi homework" ... "Homework .piles up" .., 'Teachers 
all give assignments on the same day" ... "The teachers 
don't adhere to the homewoifk ,plan" ' 

IV.* Subject Katter : • > . , \ 

1. ""The work was boring" ... "Ihe^most boring part was the 
' ' reading". . . ♦'We over things too many iimes and it 
eot borinc" ' i 



2* work I had to do so far has been fun and interesting" 
V ... "I liked the projects, they were interesting'.' .. . . "The 

; primates were especially interesting" ^ * 

' ■ ■ . , ' .• ■ ' : ' ' . i' ■• •■' . 

3. didn't have enough time for the work" I . . "1 wish we • 
, could spend more jtime t^ith one sublet'' . 

4. "Teachers spent too much time on Some activities" "I , 
got bored" . ' • * ' . 

V. Projects and ^Activities ' 

ii-i 111 iMMi-iirmrri - ir-i , , . . p , ,, B,r- ■■■im t? .* . . ' 

.1. 'tThe ptojects M activities are fun aiid .exciti^^^ . 
- ' /The activities were fun- - it ' s vdiat I like to 'do^ . 
. • "It was a lot of fiin" . • : 



2. ,"I, liked the variety of the subjects!* ... "We weren't 
just doing one part.icular thing" %. .-"You learn about 
different kxhds of animals 'and people" . 

3, ♦'♦I really enjoyed i^oing skits" ... "l-t's' really a lot 
-of fun because we get to write plays" *. . 'Very inter- 
esting, we got to do plays" u ' 



VI. Benefits 



1* '"The course taught me new things'? ... "You learn a lot 
aboiiit animals that you never knew before" . . . "You 
learn how animals live" ^ ' ' 



I. *^ 

* ti 



11 



3 



2. 'The course helped me to read better.^, . . , "I learned 
- to express my feelings" »'M)r^ttention span, improved'* 

... "I learned to spell better" 

■ . ■ \ ' ■ ■ ■ ■ •' . • 

3. - •'We learned about man's role iA nature" . . ; "They taught 
. us about animals related to ?nan" "We studied hoW ' 

„ iuiiin^ls lived and how they are different,^ 

VI I. Audiovisual Ma terials • ^ > „ 1 ' 

. t ■ i. "We get to see cooT films" ;Zv^riilced~the fi3jns~ 

they, showed me^' . ;^ "You learn .more because o£ i^ilms" 

- 2., ''The iaterial was repeated too ra^y times" "W# .-^ 
saw the salmoii film 5 times,' jus% imagine, 5 times" 
^ "We did tiid 3ame things over and over" ' 

V / 3. "The bpeklltis were inteipesting" . "I never had book- v 
lets before and Soci^li Studies was i\eveif s& much 
fun*i. ... "I liked the booklets about* animals" 

" . .. .» , . 
, 4. ' "The bopklets; were boring and, had no color" ... •'You 
;haV« to read all those booklets and it* s not any £i^^ 
< . » . "The booklets had too many questions" 
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4**^** categories inei»tio«ed in pupil respiaises. .eiviim sasmie 



>1 



3 



■ M 



2.? 



FRIC 



iP 



\ 



4-11 

TABULATING OPEN-ENM) INDICATOR miA 

Purpose , . ' * --^ 

To tally and totaTtbe-^K ^ of times each of the selected.jcate-' 
gories is mentioned in tlie xiapil responses, ' ■ • 

Procedu res ' 

' A. A tabulation shfeet should be provided (see the sample ^vorksheet 
for tabulation on the next page) with indicator code^nunibers 
^ listed .on the left and .response categories indicated along the 

■ top. ' •..■.,-> . . _ 

* •■ ■ — , ^ , , ■ , 

B. The indicators are re-read vrith special attention being given 

\ >to the responses Which relate to any one of the categories es- • ' 
■ tablished when the,- responses weibe. Categorized. '\ ' ' 

^" ■ • . ' ' ■ ' ' ■ ■ . 

C. Tally and toteil the responses (see thig , sample tally worksheet 
on page 4-14) . , , . 
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•\ *■ t ' '"SAMPLE', 

' \ mMSHEET' FOR TABULATING OPEN-ENTO INDICATOR 

■ \ • • ■ • ; . ^ . ■ .. * ■ ' 

Froni left, the columns in tMs sansple worksheet show: the .iijidicator code num- 
bers sajnpled/the overall attitudes of tlite iniiivitol piipils^ ,and the pupH re- 
sponses given on the key categories involved. N5t\^ that a- generally positive pupil 
(see codQ niunbei' 32) might have giveA negative 'responses in some categories, 



Class; 




, Ntoribor^of Indicators Sampiecl: 


IS ■ 




0 






KEY CATEGORlfe 








r> 

11 


Ii 

V 

• 

H 


f 


I 


« 


* 

ii 

*. 


1 

■ %i . 




CO 


0,1 








4 


0 i 












04 


. 0 • 


















07 




















06 


+* 








f 










09 


-^.(» 








+4 








i 


: n 


0 


0 


V 




'1*' 










1$ 










4' 




: 0 






14 








>» 






+ 


4 




j aa' 












+ 




' 4 




,20 


0 














4 




21 




i 




^ 

■4 






0 

1 






22 






4+ 


•♦•4 













25 




















30 




















32 
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inw^J S?^ ^ W data (by. classroom) in the spac*© provided below fol- 
^S^?^?^ '^^^ foWt on pgge 4-12. Ijisert blank sheets of paper 
nere, it more p^ges are neeM. . . y- , ^ ^^'^ 



'4. 
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SAMPLE 



WORKSHEET FOR TALtYjNG OPEN-ENDED INDICATOH, DATA * 

To continue the example given on page 4-12, the tally sheet .belov? 
proyides summarized' Information for one classroom on bot^i overall pupil 
attitudes and their attitudes on each Key category. For exaj^ple, the 
three totaB circled on the sample sheet -bel'oiV--4,.a, and Ir-indicate 
that of the six, pupils (4 •>• 1 + 1 = 6) with positive overall attitudes, 
■four responded positively (++, +)^ one responded neutrally (0), and 
anotlier Responded negatively (- , on the "key category of workload.'* 



CiteRories 


u 

Catmry 
CiassiffcatiQn 


1 : 

c Ovtrall Anitude aassiacation 


'Mitiyo rr^f^M 






^ Work 


Poiitive ♦) 


4m 


S 




0 


■ 0,. ' 


Neutral (0) 




0 


/ 


J 


• 


0 






0 




0 


/ 


/ I, 


Twti( 


Positiv* ♦) 




7 




0 




0 


Nwtral (0) ^, 








0 






Ne«Stlv» ••) 




0 


U 


2 


/ 




3.' 


Poiitivtt «) 


nn 




1 


1 




0 


Keutral (0) 


/ ' 




1 


"7 \ 




. 0 


Keqativtt -J 


/ 




. / • 






0 


4. Subject 
Mitttr 


Positive (♦♦, ♦) 






/ 


I 






Veutral ^(0) 


/ 


1 




0 










' 0 




0 




2 




Positive *) 


//// A. 


6 




0. 




. /O 


Hmnki (0) 




0 - 




0 




' 0 


S«fiatlvt 


/. 


'1 


/ 


1 




, 0 


*. Bencfitt 

1 


roiittve ♦} 


, 


2 




o" 




2 


VcutMt. (0) 


// 


: 








0^ 




/ 


1 




^ 




0 




rwitlv* (»♦, ♦) 


////• ' 




// 


X 




0 




N'cutr«l (0) 




0 




0 




0 




%rttiv« (•» -) 




0 




0 




0 




fVHltive (♦♦, ♦) 














t. Other. 


^f(nitral (O) 














■ 

1 










1 » 







*To sin^lify prodessing, you may change the five-point scale . 
^.ly* '^^^ ^ three-point ^cale, i.e.; po§iti\re f+f, +). 
neutra} (O)-, and negative (-', '-). . You should be aware, however, that 
by , collapsing the five categories into three, some information may be 



lost. 
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MmmmM^' mMkiowMWED iwicATOB data 
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MXy -jtmt data in t|ie space provided below followijig the sample 
fo^t-cm th© pr^coifiljig pa^e„. 'Insert blank sheets o£ paper herfe, i£ _ 
mJ^e. pages #«eeded. , " ■ - ■ 



y . ■ ' • • •. 

m 



.1- 



3 /; 



0 



data to prooeei; (SCintinm .veadin^.' 
turn- to page Ml, 



--r r-^":;)- 
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PROCESSING 'rATING-SCAIE INDICATOR DATA 

. I ^ ...... 

It is relatively simple to tally information from rating-scale 
indicators,^ because pupil .responses are given in the form of numbers. 
The procedure^ invclyed in tabulating, the data are: 

A. Entering pupil responses from the indicators san5)led on a ros- 
ter, wher6 andi^or code i^umbers and item -numbers are listed. ^ 
— r—See-the -sample on- page 4-17. ' 



B. Tallying and totalling th^ntkber of responses for each item 
according to scale value. ' See the saji?)le tabulation worksheet 
en page .4-19. ^ . 



1 '^ 



C 
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sAmple 



RATING-SCALE ROSTER- 
(FI\'ErPOII^ SCALE)*' 
S CI! 0 0 l' .D I S,T R I C T 



\ 

School r 



lAimher of students r.' 



Class: 



^"""^H^ Item 
Code No7^";-«s^ 


A::. 


B 


C 


6 

D 


E 


p. 


G 


• 


• 


• 


/ 

• • « • * A / 


P 


001 


5 


3 


1 


4 




2 


S 








... ' ^ 




•002^,, ' 


3 


'^3 


2 


4 


1- 


3 


4, 




'7 






003 ; 


4 


3 


1 


3 


i 


3 


2 










t 


»■ 


'i. 


2 


3 


4 


3 

t 


3 


3 












OQS , 


5 


3 


. 4 


2 


4 


4 




/ 










006' 






2 


3^ 












r 






■ N ^ ^ 

; 007 


t 


4 


1 


5 


' 2 


3 


. 4 












■ • 008 




3 


1 


4 


3 


3 


3 












° 009 


2 


2 


X 


3 


4 


2. 


5 












010 ^. 


4 

i 


2 


3 


5 


1 


1 


3 












Oil - 


1 


4 


1 


5 


"2 


3 


2 












. 012^ 


,3 




2 


4 


3 


2 

t 


.1 


; 










• 




* 


• * 




• 












\ 

. f. . * , '. * 
^ * 








• 




• 


• 




• 








'\ ^ 




• 


• 


• 


• 


• 




1 • 


• 








• V 




* 




« 


• 


• 


i 




• 






• 
















•* 




• 








V. 




030 


•* • 


• 






O 












4 * 

^^Tu^TT 1 n- , rr 





*The numbers recorded in the body- of this table are pupil response^ to each item 
in tenns of one, of the five points (i.e., 5, 4, 3, 2, and 1) provided, on the in- 
dicator, • ^ _ 



/ 



* 4 



. u 



>,■■■■ „ . • ■ . 

" Make a roster for y6ur' data, in the space provided below. Insert 
* , blanK sheets of paper here, if more pages are needed. 
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4-19 
SAMPLE 



School!' 



TABULATION WDRKSHPirr 
FOR A RATING*SCALB INDICATOR 
(FIVE-POINT 
SCfH^OL DISTRICT 
Cldso; 



^tober of students: 



""""""••-^.v^dlo Value 
Itan ^"^''^'•'•^-^ 


1 (Total) 


2 (Total) 


. 3 (Tbtal) 


4 ' (Total) 


S ^(Total) 


A 


/// 


3 


//// 


4 


// ' 




//// 


4 


/// 


3 






0 


/// 


■ 0 

3 


Hit" 
II 


1 


•1 r J / 

m- 


15 ' 


//// 


4 


C 


AW-/ 


6 


t f } f 

III 


8 

iHt — 


TT f f 


10 


III 


3 


/// 


5 


D 


/// 


8 




5 


m: 


10 


III 


•3 


//// 


4 


E 




III • 


a 


fft ,IM 1 


10 


nil 


-4 ■ 


III 


8 




0 


F 


/// 


«l 




s' 


m-- 
•m- 

Hit II 


17 


II 


.2 


/// 


3 


G 


/ 


1 . 


/// 


8 


JJM-* 

Vflf 


10 


1 " 


1 




0 


H 


lln 


2 


// 


7 


III 


8 


m- 
nil 


9 . ' 


//// 


4 


I 




0 




Q 


■HH- 
1 il l - 
f t f 1 


IS 


■m- 

'TTTI 


10 


MIL 


. s. 


















* 






K 








* 














— — ~— »■« 






















* 
















* 






* 










1 












• 








• 








* 






r 








* 








* 







This worksheet can be used both for tallying and totalling responses from a five 
point scale indicator. ' ' 



124 
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1 ^ 



Tally and. total your data in the space provided below* Insert * ' 
blaiik sheets of paper here, if more pages ar^ needed. 




ERLC 
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SUM^I ZING- TO DATA 
(For Both Open-enaed and Rating-scale Indicators) 



PURPOSE '" '^ ' ' 



To conjpile the tabulated data from .the worksheets into u meaningfUl 

and useful format. - 

" ' '• " ■ ' ■ . - .'■ . ■ ' 

PROCEDURES 

. A. Select a format for presenting the d^ta; . : 

The two .ba^ic foimats used to present data are tablee and * 
g^8. The characteristics of tables and graphs together ' 
with san?)les of • each €an be found on pages 4-22 - to 4-32 , ' 
Both fapBts have advantages as well as 'disadvantages, but ^ 
'together they tend to conplement each other functionally.' 
It IS usually desirable to use tables; although as a supple- 
. m^tary means of presenting information, graphs can be quite 
effective in many ways, especially in showing broad relation- 

Snips • ^ ' * 

— -~ — * - *■ 

.B/ calculate the relevant statisticTTorthe^^ 
selected* 

Spme statistics that may be appropriate are: mw toiataj • 
trequ&noij of mapone&s^ peva&ntitgeB^ meane^ and mnae, 
Information on what these statistics are and how'to calculate 
them is supplied on pages 4-33 to 4-34. 

C. ^Display the data using, the most meaningful foitnat to present 
the appropriate statistics. , ' 

* * . . 

/• Some basit: principles for displaying data are outlined 
/ on t^ie following page. ^ 



1. In the heading, all the critical Information supplied . 
(sucih as, indicator code ipibers, item ^n^ 

-of» student responses, eitc.) should be labeled, 
■•J , . - _ . ■ ' 

2. All tlie critical infonnation' should be located appropriate 

■ ■ . ■ • ly. ■ ■ ' ■ 

■ , , ' ■■ ' ■ ... 

3. The Sata; should be statistically ac«;itrate as well as , 
. easy to read.. ^ / . 

. 4. Vlhen specific exploration of a smaller area within a 
larger area is required., any detailed data displayed 
should als6 be prssetited separately ,y 

^ 5. . For open-ended indicatoi's, sah^le indicators as well as 

sant>les of pupil responses for each' category should be 
, included. See the sample table on pages 4-2S to 4-27. 

D. Finally, write one of tyto paragraphs of coifcluding remarks 
about the summairized data. Thosf remarks should be defcrip- 
tive and objective and should highlight the significant as- 
pects of the data, . 



Characteristics of Tables - 

1. Each table should. have a descriptive, heading, " , 

2. Table should consist of rows of items and coliifins of • • ^ 
' groups (and subgrotrps, if required),. ' ' ' ' 

3, Each row and column shouXd .be clearly labeied; if there 
is not enough room to supply complete headings, abbrevia- 
tions or symbols should be used vMch, in turn,, should 
he keyed at tlie bottom of the tables 

4, The most infortant figures, e.g., totals and/or extreme 
values, should be highlighted by darlcer printing or under- 



^27 



. ^ 4-23..,- ' _ > ■. ■ 

i'' ■• ' »■' ** " ' ' ' ^ 

na[ung, iftny especially si^ificant figure (e,g a 
grand total) should be indidated by dotible underiiiiine or 
-by placing it within a box* ' 

Tables should have a neat,' unclutter^ appearance and ' 
ample yargins, yet there should be enough infonnation on 
each sheet so thaV dozens of pages are not needed for the 
report and continuity ismaintainedi 

The data shoujd be expreissed in ^le numbers or decimals 
jather than fractions and' figures should be rounded off 
to the ^propriate unit* The exactness of the fi«ires 
(numbw oyecimals, etc.) should be consistent and dita 
should be lined up evilly in terjns of the. decimal points. 

All information needed to interpret the table should be 
s^^lied on the page where the .table appears. ^ 



4-24\ 



i 



A ample iahU fox> pveeentim apen'-ended indidatov 
data is given on the foUaidng three ^pages, 

A aampte table for presenting ratina-eaale indioa" 
tor data ie given on page 4'--28, , 

Twim to the'aample table which' presents the kind 
of dafa you are prooeesiiig* ^ 



■ ^LfiMTf ^ n^??^?;^^^^^ OPBf-B yH^ INDICATOR DATA - • 

nm .GRADB IPI MATH' PROGRAM IN YAMPA. VAim SCHOOL DIsmCF- 
/ Steamboat Sprijigs, CoicJradp , 




Simmry categories 
of pupU responses 



Work Ixwd; includes all 
inentlon of the ease or 
difficulty of the work 
load. 



Easy 



Difficult 



Work Interest:, the piq)- 
il's- interest in or 
boredoiD' with the units 
and activities or the 
.subject matter itself 

High interest 



Low interest 



"The work was easy.;, 
easier than regular 
classroc(n$,«' "The work 
is hardly^ anythijig." 



"The work is hard... half 
the time I don^t under 
stand it." "It^'was veVy 
difficult." 



"The work was fun and 
interesting." "More 
interesting and more 
.enjoyable classrooms." 



"IVas dumb, wasn^t taught 
well enough to be inter- 
esting." ••The work was 
very borin ;^. " 



2-5 

10-12 
13-16 



2-S 
6-9 

10»12 
13-16 



2-S 
6-9 
10-12 
13-16 



2-S 
6-9 
10-1^ 
13-16 



19 
15 
8 
16 



•^6 
S 
2 

•9 



'30t 
33t 
22t 



81 

8% 
121 



^6 
42 
7 

,37 



6 
1 
2 
6 



Sll 
581 
28) 
Sit 



81 
.11 
81 
lit 



16 
14 
6 

15 



4 
5 

Z' 
4 



36 
41 
6 

36 



// 



3 

2 
1 



2 , 
5 



1 
1 

1" 



3 
1 
2 
6 



2-S:7l^'!^9t76!^l!!il!t2r1^n3-in2^^*' ^""-^^ «unber of possible respondents in each soctiont 



1* 



Stromiiy categories 
; of pupil resifenses 



Cpurso Benefit: com- 
ments on the usefulness 
of the work in aiding 
understanding and 
l-^aming In general, or 
In teaching specific 
Knowledge^ , 

. Useful 



worthless 



Reaction to Indepen- . 
dence: includes com- 
ments made referring 
to the freedom and in* 
dividual nature of the 
program^ 

Positive 



Negative 



Sample pi^il c(»«»nts, 

■■ — — -- - - II 



'Teaches roe things 1 never 
knew before." "Relevant 
ideas instead of just 



"The work is worthless and 
a waste of time." 'Tihe 
course didn*t help'me at 
all." 



"I like the independence, 
it lets me work at fly own 
speed," 'Teaches n» to ■ 
think on ny own." 




2-S ' 

6-9 
10-12 
13-16 



2-5 
6-9 
10-12 
13-lb 



"I heed to be pushed," 
"Prefer to have tn/ work 
mapp^',d out." '"Need more 
structure/' 



2-S 
6-9 
10-12 
13-16 



2-S . 

6-9 
10-12 
13-16, 



26 
2S 
S 

30 



S- 
4 
1 



29 
33 

3S 



37i 
331 
201 
421 



7\ 

SI 



411 
431 
38t 
491 



'31 



26 
25 
4 
22 



0,. 




27 
29 
7 
32 



2-S:71,T9:?6!1S?f2r54!lSn3'}^^^^^ ''''^ '^^^^ i" e^ch 



1 
8 



2 
4 
2 
3 



section: 



131 



^^inrtiary categories 
of pupil responses 



Ihfi; course vs. last * 
yeas*s program: at-, 
tituJes toward the new- 
progranv v^en conipared 
with. last .year's clas- 
ses. Comnents of both 
general and specific „ 
natti-^ are included. 

Positive on new 



•Positive on old 



Sainple jn^^il comnents 



"I like 'open spaces • bet- 
ter.** 'TMs is a bfttef 
situation." "It's like 
being let out of jm." 



*!I liked l^t year's clas 
ses npeh better." "Too 
disorganized.*^ ''Stick to 
English." 




^5;71,l!?l•76l^l0^^2:2^Sd^^3^6?72*^® number of possible ^Respondents in each section: 



132 



ERIC 



SAMPLE 



I 



• \ : 



School: 



; TABLE DISPLAY o 
FOR RATING-SCAI,E INDICATOR DATA 
I S C H 0 0 L D I S T R I C T 

• . Class: 



Number of students: 





Scale Vaiiie 


Responses 


Petcontage of 
Frequencies 


A 


5 . • 


' IS 


501 . 




' 4 




231 « 




3 


5 






2 




' 101 




1 


■ *i , 




n 
B 


c S 


' 0 


0 




4 


■ ..5 ■ .. 


171 




3 , 


18 


60t 




2 


3 


101 




1 ' 


^ 4 


. 131, . 


c 




4 


.131 






3 


101 ^ 






10 


' 33% 




' 2 


'I . ■ 


Mi 




( 1 




m ' 




/ . s- ■ 




, 104 . 




— ' 4 


• J- ; 


33* ) 




3 • 


13 


431, * 




2 


2 


71 




1 


• 2 


n " 




« 






, 


• 


• 
• 


J : 


* 


• 
• 


t 
• 


• • 






• 

• 


: 

• 










\ 


• 

• 

4 
f 


• 
• 

4 
• 


: ■■ ' 

4 

4 



TJiis table rec\)rds pupil responses ^to each item on the indicator ' 
(Identified as \A, B, P) by frequency of tesponse and percentage 
of frequencies ^n each scale value (5, 4, 3, and 1), 



Characteristics of fa'aphs ' ^ • 

Three mam methods g£ pr^entini^. data graphically are extensively 
.used: .(1) the line graph; (2) the bar graph or histdgram; and (3) the 
divided circle or '"pie" 'nraph. Each has appropriate uses. ^ For pre- 
senti^g data ^rom eithf a open-ended or a rating-scale indicator, 
the line graph ;is least useful; the pie graph is most useful for pre- 

• i , ' ■ ■ ' 

. senting data indicated 4n percentages; ' Graphs Sould be dravni and 
labeled ^ accurately rnid. their potential for visual appeal should be 6x- 
plditod as much as possible. Shading or adding texture can be very 
useful, especially when contrasting histograms are used, with or with-, 
out overlapping. If a lijnited number of copies of the summary report 
are needed, it might be worthwhile to consider coloring the graphs to 
increase their visual appeal. - - . ^ 

Samples- of all three kinds of graphs are presented on the fol- 
lowing pages. ' , ' 



/ 



:di/^ 



SAMPLti' LINE, GRAPH' " " 
S C H,0 0 L - * D I S T,,R,I C T 
Total sample size: 150 pupils 



NUnbor of pi^ils'^ 
(in multiples of S) 



So f^r, the tethe- 
matits program has 
seemed to me^to be: 




3i * 



^ . 5 , , , ^Rating-scale ' \ 
- , -r ) • • • > Ppen-endted ftei^nse * . 



Cldi;5sification 



As this line graph shows, 20 pupils felt that the Mathonatics pro- 
grahi'was excellent, 15 said gooa, 90 acceptable^ 25 fais, an4 none felt 
that it was poor. ' ' . ' 

^Another way to present this infoimtion would be to change the nik 
hers to percentages. . ^ / 
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SAMPLE HIST0(OT4 ;(i8AR GRAPH) 
SCHOOL DISTRICT 
Total sang)!© size: 450 pupils 



V. 



NiMiber of. pupils* 
(ijj<;multiples of 5) 



So far, Social 
studies has seemed 
to me to bo: 



IS 



10 



0 



lO 10 



3 
0 



D 



. 5 ....> Rating-scale 

. • •> Open-ended Response^ 
Classification 



4^ ^ ^ 



As this histogram shows, 20 pupils felt that Sopial Studies was , 
uninteresting, 15 students felt it was fairly tmijiteresting, 50 fairly 
interesting, 50 interesting, awd IS considered ii^yr^ry ijaleresting. 

■ *Another way to present this infoimation would be to change the 
numbers to percentages. '( . 



r 



»J t) 



3 



4-32 



SAMPLE PIE GRAPH 

* * 

S C H 0 0 U . D I S T R I C T 
Total sauiple slzfe: ISO pupils 

Compared to l^t year's f^ath'ematics program, the new Mathematics 
program is: • ' 



Very Interesting 



Interesting (+) 




Unintorestijig (--) 

Fairly Uninteresting (-) 
f 

--Fairly Interesting (0) 



I, 



As this graph shows, 20% of the pi5)ils s^led said that the 
new Mathematics program was very interesting, 40% said interesting, 
25% fairly interesting, 10% fairly uninteresting, and 5% uninteresting. 



4-33 

■ I, 



Some statistics that are appropriate to use v^en displayii^ data 
are discussed below: * - ' 

1. - Raw totalis ^ ^ 

Raw totals are the actual number of responses. They 
• can be taken directly from the tally worksheets* 

4. Frequency of responses 

the frequency of responses simply show how pupil responses 
cluster under each scale value (S, 4, 3, 2, 1) or each 
category of responses covered by an open-ended indicator. 

V^oo ^"r^ ^^^^ ^ sample .table display on 
page''4"Z8. i . , 

3. Percantages | 

Percentages aire derived by dividing the number of responses 
for, eacn sca^e value by the total number of pupils in 
_ - , thc*\group and multiplying the answer by 100. See the 
percentage column in the sample table on page 4-28. 
YOU can also make stmmary statements based on the percen- ' 
, tages; on Item A in the sample table on page 4-28, 
for instance, 73% of the pupil responses were either 4 
or S on a S-pomt scale. 

4. Ihe mean (or average value) 

Ihe mean is obtained by adding a series of figures and 
dividing the total by the nuntoer of figures involved 
For example, to find the mean for the following series 
of .i^bers--6, 8, 7, 4, and S-divide 30 (the total) by 
S (the number of figures); in this case, the mean is 6. 

Sometimes frequency has to be taken into consideration 
when calculating the mean. For example, the response 
frequencies for one item are indicated on the following 



^33 



Scale Value 
S 

; 4. 
3 
2 
1 
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JResponse 
Frec^ uency 

40 

' 32 
5 
10 



Total a 90 
Meaii « 366/90 « 4.07 or 4 



Scale Value X 
Frequency 

5 X 40 «. 200 

4 X 32 » 128 

3 x 5 « IS 

2 X 10 « 20 

1x3^ 3 
'Total a 366 



Hiis meajis that the scale value 4 is the mean value 
for student respqpise^ on this particular item. 



5. Range 



The range of responses is the spread :ftrom the highest to 
the lowest response given. For example, in a S-point 
scale, the range is from 1 to 5 ♦ if responses are given 
for each of the five scale values. 
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svmmmD mu 



Display your data below in whatever format ypu consider appropriate, 
following two pages have been provided in case more space is needed. 



The aompUtion of this task marks 
th^ efid of your data pvomsHng 
effort* R&tum th0 QumariBed 
data to the Pr 03 eat Manager* 



■ 4-37 

smmnm) data 

(aontimed) 



< 



0 



J 




For use by the people responsible 
for aiaalyislng and reporting PPNA 
results. 



Bilflmir-limiiMaiiViiii 



SEQUENCE OF UNITS 



YOU 

ARE 



UNIT 1 

PLANNING A 
PPNA PROJECT 




r 


UNIT 2 

DEVELOPING A 
PPNA INDICATOR 


, 


e> ■ 



WIT 3- 



AIMKXSTmiNG THE 
imk IMjiICATOR 



UNIT 4 

PROCESSING PPi4A 
I^'*'ICATOR DATA 



UNIT 5 



ANALYZING AND REPORTING 
PPNA RESULTS 




CONTENT OF UNIT 5 ' 



Introduction. . . . '. 5-1 

Analyzing PPNA 
Results ..5-1 

Reporting PPNA 
Results 5-20 
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INTRODUCtlON 

As y((u begin the task of analyzi^ and reporting the PPN/V' results , 
you should have tM^s~oF papH aiS"^^ data 
which were prepared in terms of the' basic statistics discussed in 
Unit 4 pf this package. This unit is designed to help you perform two 
tasks >inr ord!er to conclude your project appropriately. These tasks are: 
(1) examining the data analytically and (2) preparing a report on the 
proj^t. results v^iich reflect T^upil perspectives of the area being 
assessed. The report will provide information from pupils, tlmt i«, 
one of many sources of infoimation which school district personnel can 
consider when making recomtrteaidations related to program planning and 
iinprovemeht efforts. , 

PmrmG PPNA RESULTS - 

Si 

. To examine how "good" or "meaningful" the results of your study 
are, you will have to evaluate three elajients:. (1) the validity and 
reliability of the PPNA indicator, C2) the way the data was collected, 
and (3) the procedures used to summarize and present th© data. A 
serious flaw in any of these thre^e .reas could mka the results v^-^rth- 
less. 



EVALUATING THE PPNA INDICATOR 



Validity and reliability are Wo critical concepts that should be 

considered when evaluating arty, assessment ot jnea?urement instmnent. 

Validity indicates the degree to which an instrument , 
actually measures what it is supposed to measure. The . 
validity of a PPNA indicator would depend upon the degree 
to which the indicator can supply information related to 
this purpose of the project. 

. BeUabiUi;y\ixdic&tes the consistency of results obtained 
with a given instrument. If reliable, an instrument can be 
used over am over again in unchanging or highly similar sit- 
, f uations and Jdll produce the same or very similar results. 

In this. sense, a rating -scale indicator is apt to be more 
- reliable than an op6n-ended .indicator. Reliability, hpwever, 
is not as significant as validity in the case of an open- • 
ended indicator, since it is designed to collect relatively 
subjective information from the pupils. 

^ To check the validity of your PPNA indicator, you can take any of 
the three approaches described below: 

1. Follow-up interviews - 

Interview a few pupils from the same smple asking sever- 
al broad questions related to the purpose of the pro j edit 
but not included on the indicator. . Ccfrrelate 'their 
oral responses with the written responses given on the 
indicator. If the otal and written responses are very 
sijnilar, the indicator probably has high validity. 

2. Expert opinions of the PPNA indicator - 

Ask people with experience in pupil survey questionnaire 
construction for their opinions of the validity of your 
PPNA indicator. 




3. Test the results against those of another pupil survey 
questionnaire used for the same purpose - 

It may be v&ty diMcult to find such an instrument; 
however, whenever possible, compare your PPNA results • 
with thoso of a similar, Widely-recognized pupil survey 
instrument usea for the same project purpose.. Th^ re- 
sults from both instruments should be very similar, if 
your indicator has high validity. 

■ To check the reliability of your PPim indicator, you can take 

one of the approaches described below. (These approaches are more 

appropriate for rating-scale indicators than for open-ended indicators.) 

1. Test-retest - . 

Administer the same indicator to the same pupils a 
second time. The time interval between thfe first 
administration and the second should not be leas than a ' 
week or longer than six months. If the two- sets of re- 
spcmses are very similar, the indicator probably has * 
high reliability. f / 

2. Equivalent Forms r " 

Develop another indicator with items parallel or similar 
to those in your indicator and administer the equivalent 
form to a group of pvpilfy froir, the same smple. The 
two sets of responses should be very .similar, if the in- 
dicator is reliable. 

EVALUATING HOW THE MTA WA S COLLECTED ' 

' ' ' " ' I " ' T - - 1,1, I 

Assuming that the indicator does exhibit a reasonable degree of 
both validity and reliability, the next area to consider in evaluating 
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the resin ts is how the ^afca were collected. Here, yoii should ask 
sudi questions as : . * 

, - Was the sanple (if a san?)le wa^ i^ivolved) .representative 
of the total population Covered l^y this assessment project? 

- Did the people scoring the indicators, have any laiown preju- 
dices ot preferences v*iich would affect the "results? 

- Was the scoring procedure fair (unslant^)? 

- Were questions' presented in a neutral way? 

• ^ Hopefully, lOie problenis in^lied by these questions we avoided 
in your project^ but histoiy yields countless exan5>les of cases where 
they. were not; for example, the 1936 presidential election. In 1936^ 

Literary Digest polled 10 million of their subscribers by tele- 
phone and predicted a landslide victory for Landon on the basis of 
the responses they receivfed. What happened? The sample taken only * 
included people from one. segment of the population; it was not represen 
tative. The people^ in the sample did indeed vote overwJ^elmingly for 
Landon; but the masses, who could not afford telephones anc* magazine 
subscriptions, elected Roosevelt. Such a sample is considered 
**bias0d," i.e., not representative of the total population, 

A| another example of the way results 'can be biased, consider the 
World War 11 survey described on the following page.' 



A national firvey center sent out two teams to interview 
Southern blacks on issues related to the ,war. One team 
was ^tirely made up of vMte interviewer^, the other entire- 
ly of black inteiviewers. One of the questions was, "Is 
if more important to concentrate on defeating the enemy or 
, to concentrate on-makiJig democracy work better here?" 

According tb the responses given to the black interviewers, 
39% were more interested in defeating the enemy i accoixiing 
to the answers given to the white interviewers-, i 62% were 
more\interested in defeating the en^. Other questions in \ 
^ the survey showed similarly different response patte ms. 

The results were obviously extremely, biased and, tHerefbre, worthless. 
But why wgre the results biased? Did the two teams of interviewers 
select different kinds of people to interview or did the rosiwndents ' ' 
attempts to give acceptable answers bias their responses? Either or, 
both of these explanations could be valid. Sijnilarly, Pupil -Perceived 
Needs Assessment results could be biai5<5d. For instance, do students 
answer in t^te same way wlien their teachers administer a qu0stiomiai.re 
as when other people administer lt'( 

-What can be done if you think the re,su]:ts are biased in soino way? 
Does this mean that the restalts are entirely inacciirate or incorVect? 
Kot necessarily; ix only means that it is more likely that the results " 
are not accurate. In a case like this, you would be Uss inclined to' 
rely on the results. Thus, as you review or pl^m <ii study or assess- 
ment project, it is insiJoitant to try to identify possible sources of 



^49 



bias. Hie exercise cai the following pages will provide an opportunity 
for you to practice considering several hypothetical asiscssfnent projects 

to identify any possible soirees of bias involved. 

• \ 

" • ' • . ' 

r 



\ 



' / 
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Read the d0scriptions oi the following Pupil -Perceived Needs 
Assessment proiects. Identify any possible sources of bias, then 
check your corMts against the discussion on pagfe 5-9. 

h 'J'J^^ English Departm^t of John Poe High School initiated a 
' new program of individualized reading hoping it viould inspire ptroils 
to read more^widely. To evaluate the effects of the new proeram 
a questionnaire (mostly open-ended) was administered to the pupils 
„ a month before the program began and. again four months later / 
■«i7"^?^-^\*^^"^^?*®^ questioijnaire. Since no funds were avail- 
able^for the project, Mr. Kane, the head of the Departsnent, had the 
tlTflt the indicators, from their 9wn classes. All coding 
and tallying for the^first administration of the indicator was 
. con^jieted before the second administration. 



* ^^'^^^^ Sfnith, the three counselors 

at Manual Junior High School, are interested in e3<panding the pupil 
. activity pi^ogim. In order to get funding from the Bo&rd' of -^i^a- 
tion, they must demonstratis pupil interest in this project. There- 
developed a rating-scale questionnaire and administered 
• :J Mils ^^^y hall periods. Pupils were not in- 

. structed to write their names on, the questionnaires. See the 
sarniue question from this questionnaire on the -following page 
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EXERCISE 1 (aontimed) 



How o£t©n do. you participate' 
in,th6 meetings! and activities 
of your favorite club? 



_absolutely never 
jery seldom 
seldom 
jsometimes ^ 
frebiuently - 



3, 



The m University, in cooperation with the State^of New York, 
was interested in discovering the relationship between the partici- 
pation of high school students in school decision-making (actual 
as well as perceived) and success in achievirig a few in^ortant5< 
academic and non-academic goals identified by school personnel. 
The following plan was devised: ' 

Information to be used in examining pupil participation in 
decision-making, was to be gathered through a survey of pupils 
and teachers in four urban high schools. The questionnaire 
for tlif? pupils was designed to take about 45 minutes (a 
normal class period) to coifnplete and was to be administered 
during English periods by members of the IMversity research 
staff. The schools involved in the project were select'ed 
from two large urban school systems within the state and 
.were selected because the pupils were from different social 
and rabial groups. ' ' 



Your ctjintnents cm psxercise 1 Av^d incline most of the foUowine 
points:^ „ • ' 



- TTie teachers were asked to score their own piqjiis; therefore, 
their tJreconceived ideas about pupil attitudes or abilities , 
could easily affect the results; This would probably be 
true even if the pi^ils' qtiestioimaires were not identified by 
name, sinc^ most teachers can recognize the writing styles ' 
and haariidwriting of at least sojne of their pupils. 

- Hie' teachers knew whetJie'. Jhey were scoring ''a "before'' or "after" 
^ questionnaire . If a teacher had strong feelings* (either posi - 

tive or negative) about the new program^ tliat attittide rttlght 
well injtluenco the results, Also, when scoring* individual * 
teachers iriay develop different categories of pupil responses. 
Ihis would malce tallying and suttanariajing the data difficult, 

- Finally, if the, pupils knew that their teachers would be scor- 
ing; the questionnaires (or, for that matter, even suspected it) , 
they might be influenced to give "acceptable" answers . 

2. - Probably the principal source of bias irf this exajnple lies in the' 

my the question is wordedt "of yovac favopiu club," Maybe it 
should JjsLchanged to, 'Jtow often do yoU generally participate in 
club meetings and activities?" Another source of bias in this 
exaR^le lies iUi the fact that the rating-scale is not balanced; 
that is, "absgautely never" and "frequently" are not really 
opposites. Thus, ratings would tend to Itttup toward the Mgh 
side of the scale, A better scale \A3Uld be: almost never, seldom, 
sometimes, frequently, almost always, ' ; 

3. In this example, it is questionable whether the sample selected 
.accurately represents all of„the high schools in the sfate. 
"Large urban school systems" would probably have pupils with 
different characteristics than pu¥>ils in small rural schools, "if 
the researchers wish their study to cover New York high scliools 
in general, a more representative smple would have to be used, 

y 
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WAtUATING THE PROCEDURES USED TO SUiWUZE AND PRESEm' TO DATA 

So far, in your evaluation of PPNA results, you have considered 
both the indicator and the way the information was collected. Now 
you must look at the methods followed in siummarizing and presenting the 
datar WThe'i^sults"pi^sent there multiple 

possible explanations for the results? These are but a few of the 
questions you should ask. 

tet studies or assessment pro j ects^JjjiKQlAre coii^ Your 
project probably was designed arbund one oi more^of the following com- 
nton types of comparisons: before-after conparisons, comparisons of 
different treatments, and compai^isons between subpopulations.' Implicit 
in such comparisons is the assumption that a cause-effect relationship 
may exist. For example, if a before-after comparison shows mucii higher 
scores aft&f instruction, jthe implication is that the instruction tm- . 
p'i>oved the scores. In fact, this may or miay not be true. Perhaps 
the sf^idents dieated on the second .questionnaire,' or perhaps moSt of 
tnejirrecently had seen a TV show on the subject. Explanations like 
these also coiild account for different results. One of the purposes of 
planning researdi is to attempt to eliminate as rfiany alternative 
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explanations as possible.* iNevertheless, when reviewing study results* 
you should be aware of possible alternative explaiiiations. ' Suppose you 
do discover some alternative explanations; what, does this mean, and 
viiat can you do about^it? ... ^ 

Cdnsider the following exaii5)le: ' 

The Elwood School decided to ejsperiment with a new Social 
Studies program for sixth grade pupils. Ms. Jones, one of 
the sixth grade teachers, volunteered, to test the 'program 
on her class, .After three months, a questionnaire was 
given to all sixth grade pupils concerning their attitudes 
toward Social Studies. The jSupils in the new program (Ms, 
Jones' class)- had much more favorable attitudes *tlian the 
other pupils. 

The implication is that the new program caused the more favorable 
pupil attitudes. In this case, however, a very obvious alternative 
expl|ination is ijossible- -namely, that Ms. Jones' class had different 

attitudes because of to attitude and teaching methods.' If this is true, 

' ' " - , 

her pupils, would probably have the ^same favorable attitudes whether she 
was teaching the new the old program. .Without more information, we . 
cannot determine whether Ms. Jones or the new program made the dif- 
ference. 



'"For an excellent source on experimental design information 
(i.e., planning studies to avoid alternative explanations), see Campbell, 
D. T. and Stanley, J. C. Ikper iyental an d Quas i -Experimental Designs 
for Research . Chicago: lOTllcRar^, l^^WT" *7— 



Mien several explemations oh the results are pofesible, as in the 
foregoing example, it is necessary to support your results by either 
citing sijnilar results from other studies or doing the ktudy a second 
time, in an attenpt to eliminate one or more possible alternative ex- 
planations. For example, if three other schools also found more favor- 
able attitudes toward Social Studies in pupils talcing the new progxm, 
it would be reasonable to conclude that the npw program probably helped 
develop those attitudes. In this case, careful planning could' have 
clarified thf» results by eliminating the alternative explanation. 
If the program had been introduced into three classes instead of one, 
and if student attitudes had been tested before as well as after the 
ijew program was introduced, the results "would have made it i^ssible 
to nile out the explanation thSt Ms. Jones was responsible for the 
attitudes discovered among her pupils, . - 

Alternative explanations if.j;ist be tonsidered even when the compari- 

, ' - . ■• ■ ■ 

sons show no differences. Why? Because tliat result (i.e., no dif- 

■ference) may be related to something other than the program or variable 

being studied. The follovdng case provides a perfect example. 

During 1969-1971 the Office of Economic Opportunity (OEO) 
conducted several experiments to assess the value of per- 
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foiTnance contracting In 18 different test sites, pupils 
were divided iato two groups with instruction provided to 
one group by the perfoimance contractors and to. the other 
group by teachers taking a traditional"approach^ The re- 
sults of the experiment showed no difference between the two 
groups. Is it reasonable to conclude, therefore, that the 
program offered by the performance contra^ors was no more 
successful than the traditional approach? No. Further study 
of the experimental schools revealed that both groups of 
piQ)ils exceeded average performance shown in previous years 
by over a year in most of the test sites. This was due to 
the fact that the teachers did not perform in a '^typical" 
manner, Or, as one OEO observer expressed it, ♦•Those teach- 
ers were out to show that they could do a better job than 
the outsiders" (the performance contractors) . 

The methods used to present the results must also be carefully 

scrutinized. Does^ a graph or table reflect the total picture? Are ' 

the results presented in such a way that misinterpretations are 

avoided? The examples on the foil '^wing pages show some common pitfalls 

in presenting results . 



" ^Performance contracting is the practice of giving contracts, 
to outside organizations to improve pupil reading levels or other 
similar skills. Usually the outside organization is paid only if 
the specified pupil performance levels are achieved. 
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ExampJle 1; 



GRAPH A 

Pupil Attitudes . 
Improved 




1972 1973 1974 



•H , 



GRAPH B 

' Ripil Attitudes 
Did Not , Di^rove 




1972 , ' 1973 1974 



The two graphs above show different results because one is 
based on the rnnbex* of pupils who like scliool while the other 
IS based on the peroeniage of pupils who like, school. Since 
Jf l^l .2^ °^ P^^^s increased between 1972 and 1974 
ttrom 240 to 278 to 476), percentages show pupil attitudes 
more accurately. 



i5. 
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Exanple 2: 



GRAPH A 



GRAKi B 



Perc03(itage of Pispils Partici-* Percentage of Pupils Partici- 

patijig in Political Activities | ^ pating in- Political Activities 





1972 



1973 



1974 



1972 1975 1974 



•Although' the figures used iji Graph A are visually more effec- 
tive, Graph B shows .the steady increase in partici;^)ation more 
accurately. The figures are in pioportion by height hit not 
by mass (area), therefore, the percentages reported ..using the 

. figures are distorted'. . . 

The exercise on the following page vrill provide m opporttmity 
for you to review the methods used to present the results of an hypo- 
thetical assessment project. 



1^ 
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Itead the foUwiiig desci^iptiocti of a project assessing pwpil 

lb yotj agree witii the conclusions? V/hy do you agree or 



til© Jjibrai'ito of tM^- '^d City Juitiior Sgh School have been con- 




us© of lihrary faciliities. A new set of pro- 
i which went iito. effect in January^ 
tesess pupil perception of ^^^^^^ of the 

E^s as '>^eXl as their attitudes towardlm^ ques- 
was given to all SSO itudents (2S(^ boys and 300 girls) 
20, a»d on M^TOV 20^^^^^^ W Since previous ex- 
shad imicgited a diff^r|(n<je betweett girls and boys in 
theit, lttit«de$ wgarding' the li^^ it also decided to 
consider the r^^cmses of the boys and the girls separately. 
CJne q;uesti(m a$» the pii3|)il§ to iisdicate how easy it was for 
thaa to locs^te boolJs, Their answers are tabulated beldw. 




Scal«^ "YalxDis 



te^iber Tefitiatg 



^; March Testing 
loys " "' Citis 




30 
100 



SO 
i20 
80 
40 
10 



100 
-SO 
50 
10 
10 



120 
-90 
60 
20 
10 



See the coaficlusioa^^ on the following page. 



immSE B (aontimed) 
Conclusions:/ 

- both^bdys and girls found it easier to fii^ boolcs^under the 
ne^ library procedures* 

" lilHu^^^ it easier to locate books under both the old synern 
and the new o?ie, as indicated in the graph below: ^ 



&S ISO 



100 
M 50 



O M 




-^-..^^ Boys 

:Girls 13 

An evaluation of these 
conclusions and thew: 
presentation is pro- 
vided on the following 
page. 
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^r^.:S^ ^® foregoing assessmewt project, you probably shoiild 

consi«3§r the MXowing, pointer , . . . 

.'.*■■ . ^ ' '■ *• 

- Assuming tlmt the pretest results were reliabXe (that they 
were not affected by testing Just before a holiday), the^ ' 
, results do indicate pupil perc^tions of increased ease in 
. , .10^^ bopks. The increased ease reported probably is re- 
lated the new procedures (accoHing to the infoxmation 

' . * Mthough the pretest data show gir^ 

ratings than boys on this item, the post-test data- do mtV , 
Show th;is when the results are presented in percentages. 
Since there are more girls than boys * in the san^E>le , it would 
be^better to use percentages both in tat^lating the responses 
, and m the graph, as shown below. 



Scale value 

* S (Very easy) 
4 (easy 
3 (adequate) 
2 (difficult) 
I (very difficult) 



Deceiiiber Testing 
Ws Girls 



March T estia 



n% 
m 

201 
70$ 



il7% 
401 
27% 

31 



m 

32% 
20% 



40% 
30% 
20% 
71 
3$ 




Ml 

ml 

SOI 

m 

301 



lot 



.'•V.' 

ill 



I 
I 




162 



« 
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BvaluatiJig yoiir results is the first step in developing confidence 
in them and in any recommendations to be based, on theni. To obtain 
further supj)ort. for your results, you could take any of the following ' 
steps: 

- retest the original san4)le through observation, interviews, ' 
or another questionnaire 

- determine staff^-MiSnistrator, or parent reaction to 
the findingS^'**^ ' , " . 

- test other pupils with similar backgrounds or charac- 
teristics 

: review the professional literature dealing with the prob- ^ 
lem under study 

- consider other related factors such as truancy rates/' 
v;^dalism, voluntary attendance, etc. 

In considering the steps outlined above, keep in mind that they would 

only be taken to deteimine if the new information collected supports 

, the results of the original assessment project. If'. discrepancies are . 

found, the data should be reassessed, alternative explanat: -5 investi- 

gated and, perhaps, more ijitormation collected. 



ERIC 
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REPORTING PPNA RBSliL' 



PPNA data are collected to provide imfoimatioti on which to base 
decisions or recommendations; but other groups involved -in the etluca- 
tion^l prpcess- -parents, teachers, community members, etc. --must" also 
be considered, 'Pupil -perceived needs data providd^dn;£ormation frpm 
only one source* Hailure to consider inforaation from othpr sburces 
will weaken any recommendations made. 

Typicf" it will be necessary to report results to an advisory, 
group, parents, school district personnel, or others. Although pre-' 
paring a comprehensive, clear report is a difficult task, the 
following guidelines should be helpful: , - . 

A. The report shiould include the following information: 

1. Purpose of the project, 

2. Participants in the project. j 

3. Procedures followed. 

4. Data collected,' togetlier with an analysis. 

5. Relationship of summarized data-^to the purpose of the 
project. 



^ 6, Result^ 



7. Discussion t>£ une;q)ected findings and possible alternative 
explanations . 
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B. In writing the .report; 

. 1. Consider the audience involved: their sophistication, 
their need for tedmical data, qn'=jstion5 they might. ask, 



etc. 



2. look back through the whole package, referring to the 
pink information sheets in each 'onit. The decisions 
cr information on those sheets will help you to prepare 
t ie report. . . ' 

i . \ '' 

■ 3. Wite the report as briefly and simply as possible. 
. . S jnple sentence construction will enhance clax?ty. 

llie- distri bution- of the report will depend on your situation. 
You should consider including pupil participants, principals, teachers 
,- and other school personnel involved, parents, your immediate super- 
visors, and the members of any advisor)- group. Usually, the peopl^ 
■ who have participated in a project of this kind are very interested 
^ in- the results, and a good way to assure their cooperation in future 

studies or projects- is to provide( them with information on the results. 

^The final step in ariy study, a Pupil -Perceived Needs Assessment 
or any other project, should be a review of the entire effort. Wag 

wrth the effort, tijne; and money that were expended on it? 
/ .. Where did problems occur? Would you do it again? IVhat would yeu change 
' if you were starv:ing another project? This type of evaluation is essen - 
. tial if future projects are to be iiiiproved on the basis of past exper- 
ience. . . 
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rNFOHMAHION SHEET I 
Write a summary report on your PPNA results. 
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SUPPLEMENT 
SAMPLING 




For use by the pe6pl© responsible 
for Qampling activities related to 
a PPNA piroject, x 



TABLE OF CONTENTS 



SECTION I 



Determining Smplo aize S-1 

Minimum Percentage for Sampling S-2 

Considering Secondary Variables that Might Influence 

the Decision on a Minimum Percentage for Sajipling 6-4 



Using the Sampling Chart. 
SECTION II 



Drawing the Final Sample S-19 
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The QompUng teoMique deaoHbed in thie 
Supplement had been eepeaially designed fox* use 
m this paoliage, The mtiomle and validity of 
ihia technique also have been ^oax*e fully examined 
■ '• and approved by an indftp&ndent profeasional 
atatiatioian. -» 



The Supplement eontaina two aeotiona. 
Section I helpa you to dbtemiite the total aarttple 
aize foT^yom^ PPNA project ^ as well aa the percen- 
tage of total olaaarooma to he aampMt and the 
number of indicators to be scored from, each claaa- 
room sampled. The procedurea 'deacribed in Section 
I should be completed before the PPNA indicators 
are reproduced ao that you will know how mizny 
copied are needed* Section 11 helpa you to drab) 
the final sample for proceasing your PPNA data^ 
and the procedurea deaorihed there should be com- 
pleted before the data are processed* 
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SECTION I 



i7o 



ERIC 



DFIERMINING SAMPLg SIZE ' 

The total pupil population involved' in your PPNA ptpe^^r^ybe too 
large for you to collect inionnation from each and ejfe^ pupilT If this 
is the case, you will want to draw a sample of the total population. 
This task has to be coinpleted before the PPNA indicators can be repro- 
duced. ' 

When you begin to think about this problem, the first questiotis to 
be asked are, "What size sample is sufficient for m^/ project?'* ^d "What 
sanpies do I want to take?" The purpose of this section is to provide 
some concrete guidelines to assist you in answering these questions." 

First of all, you have to decide whether or not to break down the 
total population into several subpopulations. For instance, if you are 
interested in assessing the attitudes of high^ school pupils (10th, llthf, 
and 12th graders) toward their Sciencf- program, you might want to com- 
pare the data for each of the three grade levels, if different areas 
of Science ar<^ studied in each of these three grades. Tlius, you would 
treat each grade as ,i subpopulation and draw a separate saii^le frons each 
grade. You should keep in mind that the use of subpopulations will re- 
quii*e a larger total sample than would needed if the total popula- 
tion were not broken down into subpopulations. 
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vmym pbrcentagb for sampling 

Table 1 below hfelps you to de ermine the ndniimm percentage needed 
to sample any p<jpulation or subpqpi iation involved in your PPN/V project. 
Of cowse, high«jr percentages tlisB the minimum percentages indicated' can 

also used* 

TABLE 1 

'V 

Population Size Minimum Percentage 

er of Pupils) for S»ling 



89 or less im%^ 

90 - 119 m^^ 

120 ~ 179 501^ 
180 - 239 . ' 

240 - 299 32% 

300 - t9 25^1^ 

450"- S99 20%_^ 
600 " • 899 ' 
900 - 1,349 

i,m •■ 1,799 im 

1,800 2,249 

^,2S0 - 2,699 61 

2,700 ard up 51 



■ft 
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B^ch percentage listed under Minimtcn Percentage for Sampling is 
the mid-point percentage for the corresponding population range. ••Mini- 
mum" means that gny percentage higher than the' percentage shown on Table 
1 for a given population range would be equally acceptable to use in 
determi^iing the percentage to be used in saii?)ling a given population. 

In order to find the minimum percentage for sampling your total 
populat|ioh, follow the steps below: 

1, Find the. appropriate population range for your population 
m the left-hand column of Table 1. If several sub- 
populations are involved, find the population range for 
each of them. 

2, Put a check mark (✓') next to the percentage across from 
the population rajige which covers your population (or 
subpopulation) . ^ 

Consider the example of an assessment Of ahigh school Science pro- 
gram presented on page S-1. Suppose that the total population involved 
is 600 pupils, with 240 in the 10th ^rade,. 180 in the 11th grade, and 
180 in the 12th grade, tf you wish to. conpare results- by grade, the 
total population (600) should be broken" dowii into three subpopulations 
(240, 180 and 180). According to Table 1, the minimum percentage for 
sam^)ling. 240 is 32'^, or 77 pupils, and the mijiimum percentage for sam- 
pling 180 is 40%, or 72 pupils. Adding these three sajiples together 
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(77 + 72 + 72) gives you the total sample, i.e., 221 pupils. As yon 
can see from this exainple, breaking the total population down into sub- 
populations increases the total san^^le, since for 600 pupils, the mini- 
mum percentage for sampling would be 16%, or 96 pupils. 

CONSID ERING SEODN DARy V ARIABLES THAT MIGH T INFLUENCE TOE DECISION ON A 

iroronTOKTAGE for sAMPn^r " -~ — — ~ — 

Any variables which are used to detemine subpopulations are called 
primary variables; these might include grade levels, different treatments, 
different ability levels as reflected in a tracking system, different • 
schools, etc. In addition to these variables, there might be variables 
wliich, although you do not want to analyze them e^pjlicitly, might affect 
your data. These are eeaondary variables. For iastance, when you are 
analyzing data from different classes, the charac^tTi sties of the pipils 
and/or teachers may vary in ways that signif ic^t .v siffect their atti- 
tudes but cannot be treated as primary varfMee, 

Some possible secondary variables are listed below: 

1. Grade levels (or ages, if the school is ungraded) 

2. Socio-economi'^: characteristics of different neighborhoods 
where the schools are located 

3. Intellectual abilities 

4. Sex 
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5. Race ' 

6. Family socio-economic status 

7. The length of time the pupils have been exposed to the 
program being assessed 

8. Training and personalities of individual teachers 

If any of the variables listed above were used to define. your sub- 
populations, they should not be considered eeoondary variabtee. For in 
stance, if you want to compare the attitudes of 10th, 11th, and 12th 
grade pupils toward Science, "grade level" would not be considered as 
a eeaondary vaHabte, since grade levels were used to determine the 
subpoi)Ulations , i.e., as a prmary vca*idble. Some other secondary var-, 
iables, such as the socio-economic characteristics of different neigh- 
borhoods where the schools involved are located, intellectual abilities 
or the training of individual teachers for the Science program, may 
still' have to be considered. 

Once you have taken any primary variables into account by dividing 
the total population into subpopulations, you must decide how to handle 
any secondary variables which might affect your data. .This involves 
a^essing the relative iiiiportance-of differences among and within class 
r;^nis, in order to determine what kind of sampling will produce data of 
maximum accuracy. The greater the differences among classrooms, the 



more advisable it is to saji^le more classrooms and score fewer indicators 
within each classroom for a given total sample. Relative differences ' 
among and within typical classrooms should be assessed in terms of three 
broad categories: negligible y moderate^ or great. To help you to accom- 
modate the effects of these differences, Overlays X, Y, and Z have been 
developed to be used with the Sampling Chart on page S-9. The overlays 
are used to deteimine the most efficient statistics to use for given 
populations. ' 

If^ifferences among classrooms are considered negligible, use 
OveiJa^y X with the San^ling Chart; if moderate; use Overlay Y; and if 

great, use' Overlay Z. 

Answering tlie following questions will help you determine which 

overlay to use: 

1. Are there any significant differences among classrooms? 
No. Use Over^^ay X. 

Yes. Go to the next question. 

2 . Are the differences 'amotig classrooms as great or greater 
than the differences within typical classrooms? 

No. Use Overlay Y. * 

Yes. Use Overlay Z. 



^^6 
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Fill out this worksheet with information tm your PPNA project; 

1. Consider the total pppuJation involwd in your project. Bo 
you want tp breal: it down into subpcrpulations? , 

— Yes. \ 
No. « . 

2. If i/ee, list the subpopulations "below. 



3. Record the decisions you have made on which overlay to use for 
your population or subpppulat ions below. 
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USING 1HB SA!mPLING CHART 

After you have estimated the effects of any secondary variables 
involved and selected the overlay to be used with the San^lxng Chart, 
you should be ready to ^ecide on an effective sample for each 'popula- 
tion involved, using the Sampling' Chart provided on page S-9 with the ' 
appropriate overlay. (The overlays are in the pocket at the, back of 
this Sijipplement . ) 

I On the Saii5)ling Clmrt,'the top row lists the percentages for sam- 
pling from the tight-hand cblumn of Table 1, on page S-2j the percentages 
of classrooms to be given the PPNA indicator ' ar^e listed along the left-'" 
hand side of tlje chai^t. Both sets of figures represent percentage 
ranges. If the percentage of classrooms you have decided to sample 
lies between any two percentages on the chart., the closest percentage 
should he used. ' For example, if school district personnel want 15k of 
all the classrooms involved to be given a PPNA indicator, .the closest 
percentage (16%) would be used. The fractions on the chart indicate ' 
how many indicators should te scored in each class smiled to provide^ 
accurate data on the total population involved. 

The Sampling Chart will help you modify 'the' ininimum effective per- 
centage for sampling by enabling you to take into consideration any • 
secondary variables which might affect your data. . * 

*♦ 
1 

\ 



SAMPLING CHART 




nie fractions on this chart are used to determine how many, indicator should bo scored In 
a»ch clawroom sampled, dorvjnding on tiie percentage of classrooms to be sampled (at leit). 
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Below and on the following pages, you will fird ihe steps which 
should be followed in using the Sampling Chart, together with an ex- 
anple provided to illustrate each step. ' . 



£"^jps in Using the Sampling Chart 

1. Determine the total pjpil popu- 
lation and subpopulations,. if 
appropriate. If subpppulations 
are involved, these steps 
should be followed for, each 
subpopulation. 

2i Determine the minimum percen- 
tage for sampling, using 
Table 1 on page S-2. 

3. Estijnate the differences among 
classrooms and select the 
appropriate overlay for use . 
with the Sanpling Chart. 



Example 

1. The total population is 430 
, sixth-graders (in 14 classes 
with an average of 30 pupils 
each). In this case, no sub- 
populations are involved. 



2 The minimmi percentage for 
sampling 430 pupils is 25%. 



3. The 14 sixth-grade classes 
are from three elementary 
schools dn Abington Township. 
Since (a) the three schools 
are at different stages in 
implementing the new Mathe-, 
, matics program being assessed, 
and (b) teaching mtoiods 
vary considerably in the 
three schools, school dis- 
trict personnel consider 
the differences among class - 
roooms greater* than the dif - 
ferences withi,. a tyi)ical 
classroom. Therefore, 
Overlay Z has been chosen 
for use with the Sainpling 
Chart. 



4. 



Steps in Us ing the Sampling Chart 



Place the overlay selected on 
tJio Sajipling Chart with the 
arrow' on the overlay pointing 
to the miriintum percentage for 
saii?)ling. ' Any of the percen- 
tages in the loft-hasid column 
and the fractions exposed by 
the oi'^erlay can be used in 
making yom* decisions on 
total saii?)le size. 



5. 



6. 



Decide which of the percen- 
t?jges in the left-hand column 
on the Sanpling Chart will be 
the percentage of total 
classeiv involved to be given 
the PPiv\ indicator. 



Any of the fractions exposed 
by the overlay (Ktep 4) 
across from the p-ircent^ge 
of classes involved (Step 5) 
can be used to dietermine .the 
number of indicators! to be 
scored in each class san^led. 
This fraction may, in turn, 
increase the percentage of 
the total population to be 
sanpled from the riinimum per- 
centage originally determined 
from Table 1 (Step 2). 



Example 

4. Overlay Z should be placed 
on^ the Sampling, Chart witJi 
the arrow pointing at 251 
in the^top row. Any of 
the percentages and frac- 
tions exposed by Overlay Z 
can be used in making deci- 
sions on total sm^le size, 
(See t}t8 illustration on 
page S-12.J 

5. It was decided that 67% 
(the second percentage in 
the left-hand coluim) or 
nine of the 14 classes in- 
volved will be given the 
PPNA Indicator. (See the 
illustration on page S-12,) 

6. Hie fractions e3cpos,ed on 
the Sampling Chart for' 67% 
of the classes are 1, 2/3,' 
3/5, and 1/2. In this case, 
it was decidjfitd to scorf> 3/5 
of the indicators from 
each class. Choosing 3/5 
means that the percentage 
of the total population to 
be sampled will beu40l, 
r^ither than tJie minimun 25% 
originally determined from 
Table 1 (Step 2). (See the. 

• illustration on page S-12.) 
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ILLUSTRATION OF STEPS 4. 5. AND 6 



Step 6 . 



Step 4 



Step 5 




0 V E R L A V Z 



Now determine the total sample for the example on pages S-10 and 

S-11, step-by-step, using the figures^ and percentages supplied: 

Step 1: There are 430 pupils in 14 classes (30 pupils per 
class) , 

St^ 2^ The miniwuj^i pe/rcentage for samplirg is 25%. 



U\2 



\ 
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Stop 3: Overlay 2 was chosen. ' ' 

Step 4: Overlay I was placed on the Saii5)ling Chart with the 
arrow pointing at 25% in the top row. 

i • 'if 

' Step 5: The percentage of the 14 classes Jto be given the 
indicator is 67% or 9 classes. 

Step 6: In each class (assuming 30 pupils per class), 3/5 

of the indicators Vill be scored (18 indicf.tors from 
each class). « 

,. • ■ • 

1$ indicators X '9 classes » 162 n'j.pils in the total 
sample > . < • 

In nummary, the steps in savApling are: ^ 

1, Determining the population iiiyplved as well, as any appro- 
priate subpopulations. (If subpqpulations are involved, 
the following steps sbjoiild be re|)eated for each subpopula- 
tion.) . , 



Determining the minijnum percentage needed for san?)ling. 



■4 

3. Estimating ihe differences among clasprooms and selecting 
the approprial^e overlay. " 

4. Placing the overlay selected on the San^l'ing Chart 



5. Deciding on the percentage of classrooms 



to be sanpled. 



6. Deciding, on the fraction to use in determining how many 
indicators will be scored for each class sampled. 
,. . Crbis decision, in turn, may increase the percentage of 
the total population being saiiipled.) ' 

An exercise is provided on the following page for use in practic- 

ing the stops outlined above; ' 



ERIC 



, . usm Tm smmo cum ■ . 

Pi««se au^in tJi0 Wmiks in the^^^ then ctieclc 

your ^wrs ag^st the ansWst$ |rtovid# 

'me to deumim poBsme d%ff&x^0mB in mime 'm^ 

1S^%^ff^^' ^{^^^^T' i^poput^mM tern to<? 

m8&>enth gmdme (U aUsdeB), md m Hykth gmkr& (S claBmB), 
D%Qias^t pememnet m&d to dx>oM a Bwnpla M mh gt*ade m<ih m^^ 
qmtelU p&pmeent the opiniom of th0 total poputmm itt-msh ^me. 

A -./^^^ ^ntj?2y^a oape pm vaHou^ ai^um iHtHin th& t^hip 

wht&h x'epx'eBBnt a faivty mad mftge of Bo&h-^&dmordo t&t)Bt^ (m 
Qioupoh md th&y ^hmt diffeH}^^ ^ 

tM.lMted tmdmity among th& olgBBvome bo that eaah -^Ubb mpme&ntB a' 

I Sixtlj^ graders { 540 pupils (in 18 classegl 

AccortUng to Table 1 on page S-2j the mininttiin percentage for 
Sftfji(pling is (a) :. ^ « The sixth grade c3f.£se$ do ibt 

' * vary in any discemi^e \my; Since district persomieX only ' 
ejcpect '♦negligible*' difference$„awa«^ -the cl^^ th&y de- 
cide to use Overlay Q^)^ idth the Smpling Chart, lltey 

then decide to give ^the PPm indicator to 50% of the 18 
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ainh grado classes, sanallest fraction which can be us$d 
to detsrmine how many indicators in each . sanipled class shoulcl 
be scored is (c) , ^ »°ac<:ording.to the Sampling Chart. \ 
Based on answers a, b^ an4 c, *t;he minimian sanijple si 
«a is (d) piipils. 



Sefore amtinuing, QMak youv ammm agaimt thorn' m pa^e S-i?, 



(B) ^enth gra ders: 450 'mtpi'ls 



(in IS classes! ) 



According to Table 1 on page? !5-2, • the Jninimum percentage for 
. ' san^ling. is (e) % , glnce the differences cawoMg 

these classes are al6p eacpectod to^-be tf).;,, , -■: . ; , :;, > it 

is decicied to use 0»;erlay X with the Saii^)!!^^ They 
then decide tp give the PH^ indi^tor to 60% of the IS 

*j seventh grade'\:lasses, Ihe smallest fraction f^hich can be 
used to deterJTi|he,,how nvany indicators in ^ach class j saij^led 
should be scored is (g) > according to the Sai^li^ 

Chart. Based on answssrs e, f , md g, the mlniimm sasi^jlt^ size 
calculated is (h)_^ pupils. ( 

CQ ' Bighth graders; 240 pt^lls {in 8 classes) 

According to Table 1 o!i page the minimum percentage for 
scHipling is ft), ^ Although the oSifferences mopig 



trlct persosfKri^i teid© to ■ xm Ov^Xay . (j ) . ' with the Sam- 
paing Ctot» They to &<5M«. to gl;ir<^. tli^ PiPm iuc^^caw to 
100% M th© 8 ^i%m% tmi^/^lmm. ■, m ,5mUest„ ftaetian 

, •• cXass saii|jied sSsould b^. is (10.: ".. ' » according to 

t\m Sairipli5(ig Chart. Belied m wm^t^ i\ j, arid'k, th^ minsmum 
.-. si^:© calculated is pUi^ii;?,. 

(B) Totallxjig tU $m^l®i'£QT t\m thrge grades C«mswrs d, h, and 
, 1), gives m a tota;i sloiple; o£ ptipils for a 

total popuiation of 1,230, 
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ANsmBB TO msRcm i 



(A) (a) 201. 

(b) Overlay X. Se© page S-^ for ©xplamtion. 

(c) |/5. See Saii|)ling Chart cm page S-9. 

(d) Iwpwpils. 

Btplanation; 50% of 18 classes « 9 classes 

2/S d£ each class (30 pipils each) « 12 pupils 
12 pupils X 9 classes « 108 pupils 

If cmy of Romans. ' wem not oorveot, revieu) the atep-hy-at^p 
exampU m pages S-lO and before retumirig to page S^-IS to aontime 



(G) m 32%. 

n) CSrerlay Y. See page S-6 for e^slanition, 

(3c) 1/3. See Sampling Chart. 

(1) Mpupils. 

E3cplanation: 1001 of 8 classes « 8 classes 




Bxplaimtioii: 



601 of IS clashes ^ 9 classes ,;" 
VI of e^^ class (30 pupils each) « 10 piipils 
10 pupils? ^ 9 classes « 90 piipils 



1/3 of Mch class (30 pupils each) * 31,0 pi^jils 
10 pupils % 6 classes * 80 pupils 



(m) 278 pupils. 



Total sajitple: 108 90 + 80 * 278 pupils ' 



"Bleaae turn io Information Sheet 1 
on the fotUtdng page* 



rv, ' ... , have oomplet'ed Eoseroiae 1 
aaou. 'ly^ you ahfuld be reajpty to 
detex urn ^^ovw oijini ampls ais^e* 
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> mOimU'ION SHEET 1 

SAMPLE SIZE 



1 information sheet to rocord infomtion and 'decisions , 

^l^^:. subpopulations are involved in 

K S?' ^ ^^^^ should be reproduced and ..appropriate informa- 
taon supplied for each subpopulation,) \ 

1. Total pupil population: . 

2. Minijnum percentag)^ for sampling: - J' 

3. llie differences among classrooms are expected to be: 

Negligible; therefore, Overlay X will be used. 

... ^Jo^iei^ate; tI;iorefore, d\rerlay Y will be used. 

.Great; therefore, O/erlay Z will be used. 



4. After placing the selected overlay on the Sampling- Chart, it was 
decided to give the PPNA indicator to % of the class- 
es involved, ' . — ^ 

5. On the basis of Step 4, it was decided that the fraction 
would be used to deteimine how many indicators -in each cl^ 



sampled would ^be scored. (If you selected 1 rather than a fraction, 
all of the indicators in" the classes sampled should be scored.) 



SeaHo'rt II of Mb Supplement provides 
guMMn&s for uee in draining your 
final eample. 

If you have deoided to eaore all. of 
the indiaatope in the alaae&e empled, 
you will not need to refer to Section 
TI../ 

If §ou have decrCded not to eaore all 
of the indiaator& irTtfie (flaesee eam^ 
pled, refer to S&otion II aft&r th& 
completed indiaatore have Mm ooU ; 
l&ated for eaoring and prooeoeing, 




• SECTION II " 
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DRAWING THE FINAL' SAMPLE 

As you start reading this section, you should have all of the 
completed indicators from the classes sanpled. This section, describes 
sampling procedures designed to help you draw a final sanple before 
processing your PPNA indicator data. These sanpling procedures vrere 
developed expressly for this padkage. The instructions should* f»e followed 
carefully to achieve satisfadtory results. ' . 

Tables 2 and 3 are provided to facilitate the actual drawing of an 
appropriate sanple of the indicators collected for processing. It is 
suggested that you familiarize yourself with these tables before reading 
the instructions on drawing a final sample. 



TABI£ 2 

SELECTION NmiBERS BY FRACTION TO BE SAMPLED 



Fraction of Fach 


Selection. Numbels 




Class Sampled 




Bcplanatlon 


2/3 


. 2, 4, 6, 7, 8, 10, 12 


Even numbers 5 7 


3/S 


2, 3, 4, 5, 6, 7 


Numbers 2 thm 7 


. 1/2 


' 2, 4, 6, 8, 10, 12 


Even numbers 


2/S 


„2, 3, 4, 5, 6 


^^^nb©rs 2 thru 6 


1/3 


3, 6, 9, 12 


Miltiples of 3 


3/10 






1/4 


4, 8, 12 


Multiples of 4 


1/5 


5, 10 


I^ltlples of 5 


1/6 


6, 12 


Matiplds of 6 


1/8 


8 




1/10 


9 




1/12 


10 


1 



■ o 
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TAni.n 3 . 

SAMPLING 'mm 

CODE SHECnON NUM!}F.RS' FOR DIUiv'INO RANDOM SM^IVS ^^^^^ 

— , i 11 111 E 1 Yl . ^s' 

[ 7 « 5 10 ' 3 A J 

i iO 5 ? 7 6 5 2 

3 '0 5 n 5 6 7 3 

f 7 5 -6 4.4 6 4 

6 .. ?> 9 y g 7 5 

* 7 ^ J 7 5 " g 

7.7 4 S .10 11 12 7 

« 5 < \ 4. • 6 7 7 « 

^ ^ 9^ ^ 5 7 » 

1J 5 6 i 6 7 11 11 

n 9 7 6 $ f( 10 12 

'3 5 9.4 S 6 4 13 

'2 7 6 8 J 4 ;4 

f 3 7 n 5 « 75 

T6 g Td To T"^ — ~1 ^ 

J7 11 7 10 5 5 >7 

. 6 10 . 7 4 12 $ 

/9 S 9 ' 5 7 5 2 /9 

- ^0 9 f2 7 7 >0 9 20 



21 9 9 3 ;Z JO • 3 21 

^ 4 12 6 9 9 22 

23 i 6 2 3 9 < 23 

24 < « 7 9-7 J» 24 

44 7 _L S 5 g 25 

6 6 i — • 3— 7 —j^ 

27 7 I f(? 9 9 5 27 

9 7 « , S 7 t 28 

29 5 n 4 11 6 6 2.9 

3f ^ 9 .3 8 « 7 • 30 

5^ 8 • 5 7 ; 9 3/ 

32 ! « 7 6 3 6 32 

33 S ^ 9 A 8 n S2 

34 10 3 11 10 6 3 34 

35 , 3 ! 10 6 1 11 7 35 

J7 ) S 10. S n 4 6 37 

8 7 7 9 !2 5 38 

39 , 4 8 7 5 8 3 39 

7 4 8 8 5 6 40 

^\ > 9 . 4 C 9 ' 11 41 

42 10 7 S 10 $ 7 42 

43 6 . 9 6 7 4 43 

44 6 \10 S 6 9 6 44 

45 .__3 ^ 10 11 6 9 45 

^ ^ g ^ ^ y 

47 9 2 3 1 4 10 47 

4i r ;2 n 4 t t 4s 

49 5 5 6 3 12 S . 49 

5<? 9 9 5 ^ 5 7 7 50 



i 

S-2.1 . 

The three columns in Table 2 on page S-19 are explained be,Tow: . 

The FraoUm of E'doh Claas Sampled column lists the various 
fractions v^dch can be ^jsed to determine how many indicators in each 
class sanpled should be scored. This fraction was selected when 
Section ! of this Supplement, was ccn5>aeted. (Sea Information Sheet 1 
on page S-18.) Place an ::X" next to that fraction on Table 2. 

The second column, SelhoHon Numhera, lists sets of numbers to 
be used in^drawing smtpl^r, based on each of the fractions listed in 
the first C(^(lumn. (TJie use of these numbers is explained in the section 
on procedures for using Tables 2 and '3.) 

The last' column, ExplcmaUon, provides the- general rules followed 
in sel6<;ting tlie numbers to be used with each fraction. 

Far exajT|)f6, if one- third (1/3) of the indicators in each class ' 
ar^ to be scored, the selection numbers are multiples of three f i.e., 
3, 6, 9, and 12}. 

Table 3 on page S-20 contains two kinds of numbers: (1) the 
code numbers on both .sides of Table 3 (1-50) correspond to the coded 
pupil indicators frotn 6a^h class; (?) Columns I -VI» provide lists of , 
randomized numbers to use in selecting indicators which' correspond to ^ 
the seleaUvn number e determineji from Table 2. 
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'Hie procedures for using Tables 2 and 3 are outlined and illus- 
trated below: \. ■ ' . ^ 

■ 

1. Have the indicators assembled by classroom. Mix the 
indicators so that they are not in order by pupils' 
names or seating arrangements. Code numbers should be 
assigned to each indicator. For instance,' if ther^ are 
33 pupils' in a *given class', numbers from 1 to 33 can be 
assigned to the indicators. Do this for each partici- 
pating class. 

^ ^ 2. Refer to Table 2. Put a checkmark (/) next to the 
fraction to be used in determining how many indicator's 
^are to be scored from each class san^l'ed." For example,- 
if 1/2 is the fraction selected, put a check mark (✓O 
next to it; n(.te that the selection numbers for this 
fraction are '4, 6, 8, Ip and 12. These selection " 
numbers will be used to determine from Table 3 which' ' 
> pupil indicators should be scored. 

3. Now take* one die and throw it to decidfe which column in 
Table 3 (I -VI) to use, I^r exan^le, if you get a 3 on 

' . the die, start with Column III. 
< ' - 

4. Look down the column sel^scted and pick out all of the 
; selection numbers determined in Step 2. To continue 

with our illustration- -look down Column Ilf, noting 
■ . all even numbers (i.e., 2, 4, 6, 8, 10, and 12) up to 
the 33rd code number (because there are only 33 pupils 
in this particular class). Doing this, you will find 
the following even numbers: 6, 8,' 8, 4, 8, 6, 4, 6, 10, 
10, 12, 2, 6, 10, 8, and 4. 

5. Loolc across Table 3 'from the 'select ion numbers listed in 
the column selected tj the nearest side column showing 
the corresponding code numbers. For our example, the 
code numbers \Mch correspond to the selection numbers 

, identified in Step 4 are: 4, 7, 8, 11, 12, 13, 14, / 
' 16, 17, 22, 23, 26, 27, 28, aiid 29. These are the 



/ 
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• • • . 

code numbers o£ the indicators which would be processed 
from this class. 

Repeat Steps 3 to 5 for each classroom sampled. - 

If you/ are sampling subpopulations for which different 
frac;:ions are being us^d, repeat Steps 2 to 6 for each'* 
subpopulation. - ' ' 
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EXEBCISS 2 



Answer, the following questions to «ialf,e sure that you understand 
how Tables 2 and '3 should be used. 

1. Which table, lists ^election numbers? 
Ai^swer': . . 



2. F^ind the selection numbers for the firaction |/S. 



Answer: 



3. For which fraction are the selection nimibers 3, 6, 9, 12 used? 



Answer: 



4. If you throw a 4 on the die, which doliimn will you use in Table 3? 

** • • . 

Answer: . " - . ^ 

5. Given coded indicators 1-28, dr^, 1/6 of them as a sample Usiiig 
Column I of Table 3. r 

« ^ . . ' 



Ch&ok yoiA3}, an&w&re against those 
eupplUd on the following page. 



AimSRS TO EXMCISE Z * 



Table .2^ 



2, 3> 4, 5, 6, and 7, .' ' . <e • 

1/3. ' . ' ' 

IV. ' ' ' ^ ' '. . ' . • ^ • ' 

5, 14, 18, 24, and 26 . (Using selection iiunibers 6 and l^for 1/6.) 

■ * * 



V 



■"I * ^ 



0 



1 • . . 

^ ' ^ If any of youx^^amva mipe in-* 

aon^eoti af»et;Tet<? pagee $"21 to S-SS 
befox^ aontinuirig* 



I 



\ 



1 ♦ 
1 



\ 



INFOEMTION ' SHEET 2 
. Fim SAMPLE 



Use this information sheet to /record information' related to your ^ - 
decision on drawing a final ^ sample.. , (If any subpopulations are irorol^ed 
. in your project, this page should be reproduced^nd appropriate Informa- 
tion 'supplied on each subpopulation,) .' • 

ft ' - ■ ■ 

.. 1 . , The fraction to be used in determining how many indicators in each 
, / class sampled should be scored is_ . ■ ' ' 

This fraction was selected when Section I ^bf this Supplement was com- 
pleted.) 



. 2. • According to Table ^2, the selection numbers for" the fraction * 
selfecjled are: 

Repeat tl^e fo^owing steps for eabh class sampled: *" 

3; Tlnrow pne die to select a number between 1 and 6. , 

. 4. ¥md^ the Column number (in roman numerals) in table 3 which cor- 
responds to the numW selected in St3p 3, /Refer to that column 
(Column iJi • 

5, - Read down the column chosen in Steo 4 and find all o:^t§Pelection 
' ^ numbers identified In Step 2; thenVnote down the code nSlJers (in 

' nearest side coltimn) which correspond to those selfectibn numbers. 
— The c<?de-numbers are:^ --— — 

6. 'me indicators identified by code number in Step 5 make up 'the final* 
^^^aitple of indicators to be scored for each class. 



Aft'er you' have aompleM thio in- 
fomation eh&et, you -should have 
, aofnp.'eted the taek of deaUing 
which indioatoTs 'in eash atass earn'-' 
pled wilt be soohed. Give this' 
infomation to' the Project Manager^. 
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